-- Logs begin at Sat 2022-09-24 13:45:52 UTC, end at Sat 2022-09-24 14:52:30 UTC. -- Sep 24 14:17:31.411773 dv-cinder-859193-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 14:17:31.419069 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 14:17:31.421088 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 14:17:31 2022] *** Sep 24 14:17:31.421088 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 14:17:31.421088 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 14:17:31.421088 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: nodename: dv-cinder-859193-1-iscsi Sep 24 14:17:31.421088 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: machine: x86_64 Sep 24 14:17:31.421088 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: clock source: unix Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: pcre jit disabled Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: detected number of CPU cores: 4 Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: current working directory: / Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: detected binary path: /usr/bin/uwsgi-core Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: your processes number limit is 47680 Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: your memory page size is 4096 bytes Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: detected max file descriptor number: 2048 Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: lock engine: pthread robust mutexes Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: thunder lock: enabled Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 14:17:31.421513 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 14:17:31.462145 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: Python main interpreter initialized at 0x558c7574b9c0 Sep 24 14:17:31.462145 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: python threads support enabled Sep 24 14:17:31.462145 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: your server socket listen backlog is limited to 100 connections Sep 24 14:17:31.462145 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: your mercy for graceful operations on workers is 90 seconds Sep 24 14:17:31.462521 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 14:17:31.462604 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: *** Operational MODE: preforking *** Sep 24 14:17:31.462869 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: *** uWSGI is running in multiple interpreter mode *** Sep 24 14:17:31.462869 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: spawned uWSGI master process (pid: 105510) Sep 24 14:17:31.463060 dv-cinder-859193-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 14:17:31.464442 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: spawned uWSGI worker 1 (pid: 105511, cores: 1) Sep 24 14:17:31.464442 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: spawned uWSGI worker 2 (pid: 105512, cores: 1) Sep 24 14:17:31.464442 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 14:17:32.123567 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:17:32.135739 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:17:33.210507 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:17:33.210507 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: from cryptography.utils import int_from_bytes Sep 24 14:17:33.211137 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:17:33.211137 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: from cryptography.utils import int_from_bytes Sep 24 14:17:33.214770 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:17:33.214770 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: from cryptography.utils import int_from_bytes Sep 24 14:17:33.215216 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:17:33.215216 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: from cryptography.utils import int_from_bytes Sep 24 14:17:35.727833 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:17:35.728449 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:17:35.728631 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:17:35.728981 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:17:35.729244 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:17:35.729630 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.729958 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.730282 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.730604 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.730964 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.731280 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.731597 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.731916 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.732243 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.732505 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.732821 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.733145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-1-iscsi {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.733468 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.733774 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.734085 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.734437 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.734746 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.735095 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.735403 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.735895 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.736343 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.736656 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.736970 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.737255 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:17:35.737647 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.737743 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:17:35.737825 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.737912 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.738050 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:17:35.738211 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.738404 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:17:35.738531 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.738670 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:17:35.738887 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.739088 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.739192 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.739424 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.739594 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-1-iscsi {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.739753 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.739908 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.740080 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.740221 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.740417 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.740535 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.740735 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.740952 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.741047 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.741284 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.741388 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.741587 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.741692 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.741909 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.742008 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.742232 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.742315 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.742545 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.742647 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-1-iscsi {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.742891 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.742981 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.743204 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.743292 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.743522 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.743653 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.743839 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.743926 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.744144 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.744244 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.744454 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.744541 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.744765 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.744850 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.745081 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.745268 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.745374 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.745583 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.745671 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.745891 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.745985 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.746204 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.746310 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.746523 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.746608 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.746865 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.746968 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.747181 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.747273 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.747433 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.747521 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.747687 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.747802 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.748008 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.748129 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.748332 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.748651 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.748751 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.748964 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.749070 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-1-iscsi {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.749271 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.749439 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.749584 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.749758 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.750413 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.750592 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.750746 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.751084 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.751178 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.751396 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.751554 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.751717 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.751974 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.752160 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.752461 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.752768 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.752768 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.756093 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757007 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757109 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757194 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757276 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757364 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757456 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757547 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757635 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757716 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757795 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.757873 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758036 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758128 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758208 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758286 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758365 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758443 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758534 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758623 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758623 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758774 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758868 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.758977 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759061 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759141 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759226 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759305 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759390 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759478 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759569 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759782 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759880 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.759962 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760050 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760145 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760226 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760306 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760385 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760464 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760551 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760631 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760717 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760805 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760886 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.760971 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761058 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761144 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761222 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761300 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761378 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761455 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761586 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761682 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761770 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761856 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.761947 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762044 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762125 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762204 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762282 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762360 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762478 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762578 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762668 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762748 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762874 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.762999 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.763099 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.763399 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.763495 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.763652 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.763738 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.763967 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.764055 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.764291 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.764379 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.764611 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.764699 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.764920 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.765006 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.765225 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.765326 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.765610 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.766210 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.766419 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.766561 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.766723 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.766838 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.767061 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.767148 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.767371 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.767478 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.767682 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.767771 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768001 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768093 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768261 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768360 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768566 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768652 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768876 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.768963 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.769194 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.769288 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.769502 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.769596 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.769812 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.769946 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.770117 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.770231 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.770416 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.770533 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.770720 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.770848 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.771048 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.771160 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.771351 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.771440 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.771654 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.771764 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.771960 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.772055 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.772271 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.772360 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.772579 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.772679 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.772883 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.772971 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.773184 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.773280 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.773490 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.773577 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.773811 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.773909 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.774132 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.774220 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.774442 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.774537 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.774751 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.774872 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.775087 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.775184 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.775400 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.775490 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.775723 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.775813 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.776033 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.776120 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.776342 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.776440 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.776663 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.776758 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.776971 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.777057 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.777279 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.777374 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.777592 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.777680 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.777901 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.777995 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.778216 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.778317 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.778538 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.778633 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.778862 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.778954 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.779176 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.779278 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.779495 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.779589 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.779804 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.779917 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.780121 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.780218 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.780418 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.780505 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.780724 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.780812 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.781032 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.781155 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.781365 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.781453 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.781693 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.781780 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.781984 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.782080 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.782286 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.782382 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.782905 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.783021 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.783225 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.783322 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.783535 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.783642 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.783843 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.783931 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.784148 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.784243 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.784470 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:17:35.784565 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.784781 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.784879 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.785100 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.785190 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.785415 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.785511 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.785736 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.785832 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.786051 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.786141 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.786363 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.786452 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.786675 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.786780 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.787014 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.787110 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.787327 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.787417 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.787664 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.787760 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.787979 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.788067 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.788298 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.788384 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.788610 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.788712 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.788920 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.789007 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.789242 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.789332 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.789556 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.789658 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.789905 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.790041 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.790178 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.790267 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.790485 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.790591 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.790790 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.790899 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.791118 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.791209 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.791429 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.791527 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.791735 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.791823 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.792057 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.792149 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.792387 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.792484 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.792694 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.792789 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.793027 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.793129 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.793329 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.793420 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.793642 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.793733 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.793971 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.794079 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.794264 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.794404 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.794566 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.794653 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.794906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.795013 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.795219 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.795308 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.795523 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.795612 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.795847 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.795947 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.796156 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.796243 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.796462 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.796552 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.797303 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.797413 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.797608 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.797696 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.797916 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.798003 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.798233 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.798321 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.798543 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.798630 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.798880 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.798983 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.799201 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.799292 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.799513 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.799606 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.799830 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.799931 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.800137 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.800226 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.800450 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.800547 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.800761 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.800848 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.801076 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.801166 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.801391 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.801488 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.801696 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.801792 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.802005 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.802093 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.802312 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.802398 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.802621 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.802721 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.802955 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.803102 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.803261 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.803357 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.803567 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.803733 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.803872 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.803969 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.804183 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.804272 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.804487 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.804588 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.804794 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.804890 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.805102 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.805190 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.805406 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.805496 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.805710 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.805803 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.806027 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.806115 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.806333 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.806421 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.806638 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.806731 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.806963 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.807061 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.807269 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.807368 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.807586 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.807673 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.807908 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.807996 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.808217 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.808305 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.808528 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.808615 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.808849 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.808945 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.809165 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.809253 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.809484 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.809571 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.809801 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.809898 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.810111 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.810205 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.810429 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.810519 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.810741 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.810873 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.811077 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.811166 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.811401 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.811496 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.811716 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.811814 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.812027 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.812158 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.812337 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.812453 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.813208 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.813314 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.813523 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.813612 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.813827 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.813913 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.814141 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.814231 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.814452 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.814577 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.814760 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.814869 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.815095 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.815175 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.817725 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.817878 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.817991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818097 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818217 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818325 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818433 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818547 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818654 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818768 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.818953 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819064 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819170 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819285 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819394 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819509 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819617 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819722 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819827 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.819932 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820058 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820159 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820243 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820325 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820445 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820534 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820615 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820795 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820877 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.820957 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821036 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821036 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821191 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821191 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821338 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821418 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821499 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821592 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821675 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821843 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.821930 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.822011 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.822100 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.822189 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.822392 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.822490 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.822705 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.822793 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.823272 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.823372 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.823454 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.823534 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.823649 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.823740 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.823962 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.824051 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.824271 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.824359 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.824580 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.824725 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.824883 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.824972 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.825200 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.825288 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.825512 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.825610 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.825819 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.825908 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.826130 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.826252 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.826443 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.826554 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.826766 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.826871 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.827104 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.827200 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.827415 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.827516 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.827730 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.827819 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.828057 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.828147 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.828365 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.828462 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.828686 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.828781 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.828995 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.829088 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.829306 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.829396 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.829612 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.829701 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.829919 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.830007 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.830237 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.830323 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.830547 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.830642 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.830866 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.830956 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.831189 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.831286 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.833147 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.833793 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.833885 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.833980 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834064 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834144 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834223 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834309 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834467 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834558 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834646 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834754 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834840 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834911 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.834991 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835073 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835163 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835243 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835321 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835406 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835494 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835575 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835659 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835739 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835816 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835902 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.835990 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836077 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836157 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836242 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836321 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836409 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836495 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836575 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836653 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836732 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836895 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.836993 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.837228 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.837472 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.837560 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.837814 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.837901 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.838137 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.838225 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.838459 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.838545 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.838767 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.838893 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.839119 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.839225 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.839431 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.839526 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.839740 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.839828 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.840047 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.840143 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.840357 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.840445 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.840678 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.840777 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.840986 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.841088 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.841293 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.841380 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.841601 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.841687 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.841910 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.842014 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.842218 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.842305 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.842525 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.842612 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.842852 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.842960 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.843158 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.843251 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.843464 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.843553 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.843795 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.843885 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.844103 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.844191 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.844417 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.844502 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.844719 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.844814 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.845034 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.845131 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.845335 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.845436 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.845657 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.845744 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.845963 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.846056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.846270 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.846371 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.846574 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.846669 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.846899 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.847010 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.847217 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.847321 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.847531 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.847625 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.847871 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.848104 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.848200 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.848446 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.848534 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.848771 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.848866 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.849098 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.849197 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.849429 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.849516 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.849735 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.849837 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.850043 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.850131 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.850346 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.850434 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.850674 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.850842 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.850992 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.851083 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.851297 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.851386 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.851610 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.851697 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.851916 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.852001 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.852223 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.852317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.852531 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.852661 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.852833 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.852920 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.853139 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.853226 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.853439 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.853525 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.853748 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.853845 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.854054 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.854141 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.854357 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.854444 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.854659 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.854755 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.854995 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.855087 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.855300 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.855385 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.855599 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.855699 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.855911 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.855998 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.856212 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.856300 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.856527 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.856700 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.856831 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.856917 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.857131 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.857269 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.857436 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.857524 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.857743 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.857837 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.858053 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.858142 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.858357 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.858454 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.858681 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.858769 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.859034 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.859123 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.859850 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.859945 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.860156 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.860251 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.860467 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.860555 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.860771 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.860904 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.861075 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.861169 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.861380 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.861474 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.861693 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.861781 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.862006 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.862093 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.862307 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.862402 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.862618 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.862760 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.862950 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.863048 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.863255 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.863355 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.863559 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.863647 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.863864 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.863952 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.864165 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.864260 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.864468 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.864556 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.864768 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.864856 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.865073 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.865162 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.865374 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.865461 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.865676 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.865761 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.865989 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.866077 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.866296 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.866384 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.866600 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.866687 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.866926 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.867029 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.867233 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.867369 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.867558 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.867646 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.867867 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.867963 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.868175 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.868264 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.868482 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.868583 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.868795 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.868883 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.869108 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.869202 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.869414 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.869514 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.869725 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.869814 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.870030 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.870120 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.870333 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.870433 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.870640 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.870740 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.870974 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.871061 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.871279 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.871376 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.871580 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.871667 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.871891 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.871977 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.872200 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.872295 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.872511 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.872600 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.872816 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.872910 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.873130 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.873219 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.873438 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.873527 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.873738 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.873870 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.874041 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.874129 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.874349 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.874435 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.874651 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.874745 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.875030 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.875608 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.875831 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.875928 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.876134 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.876227 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.876440 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.876536 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.876750 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.876837 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.877064 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.877167 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.877378 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.877467 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.877674 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.877760 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.877978 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.878074 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.878285 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.878380 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.878592 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.878680 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.878943 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.879048 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.879258 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.879348 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.879564 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.879659 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.879877 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.879973 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.880185 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.880280 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.880499 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.880584 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.880801 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.880895 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.881109 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.881230 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.881429 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.881546 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.881747 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.881860 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.882065 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.882154 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.882376 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.882472 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.882684 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.882773 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.883035 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.883130 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.883351 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.883450 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.883667 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.883756 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.883989 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.884076 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.884315 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.884411 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.884639 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.884728 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.884947 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.885034 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.885259 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.885358 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.885565 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.885653 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.885873 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.885963 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.886189 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.886349 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.886493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.886581 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.886803 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.886944 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.887482 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.887582 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.887582 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.887712 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.887785 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.888063 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.888153 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.888394 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.888469 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.888717 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.888800 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.889038 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.889124 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.889384 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.889667 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.889995 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.890315 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.890654 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.891011 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.891122 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.891322 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.891437 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.891641 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.891791 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.891952 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.892151 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.892387 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.892576 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.892709 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.892947 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.893041 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.893281 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.893378 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.893621 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.893716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.893936 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.894035 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.894259 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.894364 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.894580 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.894667 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.894916 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.895009 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.895305 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.895391 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.895628 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.895728 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.895966 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.896057 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.896280 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.896374 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.896591 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.896688 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.896902 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.897002 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.897225 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.897351 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.897556 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.897692 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.897866 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.898016 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.898178 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.898340 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.898489 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.898677 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.898829 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.899028 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.899147 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.899344 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.899477 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.899669 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.899902 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.899999 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.900223 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.900310 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.900534 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.900629 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.900896 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.900993 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.901220 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.901308 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.901540 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.901631 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.901859 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.901949 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.902174 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.902270 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.902487 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.902575 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.902797 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.902902 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.903139 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.903227 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.903452 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.903539 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.903772 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.903868 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.904098 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.904228 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.904418 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.904514 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.904729 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.904818 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.905037 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.905123 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.905356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.905456 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.905669 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.905757 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.905979 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.906129 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.906328 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.906424 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.906723 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.906838 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.907079 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.907166 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.907398 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.907759 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.907994 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.908093 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.908328 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.908415 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.908637 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.908733 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.908949 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.909047 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.909267 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.909355 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.909582 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.909673 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.909895 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.909983 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.910218 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.910312 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.910528 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.910616 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.910863 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.910952 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.911178 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.911277 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.911493 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.911582 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.911801 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.911887 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.912107 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.912193 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.912412 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.912501 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.912727 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.912817 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.913035 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.913131 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.913342 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.913440 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.913650 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.913738 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.913976 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.914071 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.914281 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.914368 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.914605 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.914698 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.914938 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.915046 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.915249 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.915337 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.915551 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.915638 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.915860 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.915956 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.916201 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.916288 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.916509 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.916602 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.916838 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.916934 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.917151 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.917239 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.917476 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.917572 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.917793 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.917881 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.918109 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.918196 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.918431 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.918527 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.918752 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.918858 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.919097 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.919186 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.919417 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.919515 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.919736 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.919828 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.920044 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.920131 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.920354 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.920455 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.920670 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.920758 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.920980 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.921067 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.921288 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.921510 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.921643 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.922338 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.922431 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.922657 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.922745 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.923001 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.923093 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.923317 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.923404 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.923635 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.923731 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.923942 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.924030 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.924255 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.924375 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.924567 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.924663 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.924877 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.924979 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.925183 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.925269 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.925491 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.925588 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.925821 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.925909 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.926131 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.926213 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.926464 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.926564 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.926782 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.926898 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.927125 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.927214 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.927444 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.927534 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.927762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.927848 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.928085 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.928173 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.928409 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.928501 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.928714 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.928845 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.929031 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.929128 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.929347 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.929441 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.929661 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.929748 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.929977 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.930074 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.930291 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.930380 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.930607 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.930703 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.930946 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.931164 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.931264 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.931501 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.931589 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.931821 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.931915 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.932141 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.932230 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.932459 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.932546 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.932780 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.932876 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.933100 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.933188 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.933412 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.933513 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.933726 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.933823 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.934040 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.934126 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.934356 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.934554 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.934689 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.934891 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.935050 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.935228 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.935382 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.935555 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.935721 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.935882 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.936044 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.936198 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.936364 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.936518 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.936689 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.936848 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.937007 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.937158 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.937391 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.938051 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.938228 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.938370 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.938541 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.938685 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.938884 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.939019 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.939208 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.939352 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.939528 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.939665 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.939846 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.939976 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.940162 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.940300 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.940479 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.940614 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.940797 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.941114 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.941204 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.941430 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.941525 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.941746 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.941889 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.942066 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.942155 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.942394 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.942482 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.942714 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.942824 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.943050 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.943148 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.943373 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.943460 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.943679 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.943775 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.943988 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.944086 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.944308 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.944508 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.944623 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.944827 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.944917 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.945163 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.945251 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.945491 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.945587 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.945817 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.945904 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.946119 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.946213 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.946431 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.946523 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.946739 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.946860 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.947087 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.947173 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.947391 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.947491 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.947699 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.947795 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.948012 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.948100 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.948323 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.948420 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.948627 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.948715 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.948934 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.949067 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.949244 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.949341 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.949549 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.949637 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.949859 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.949948 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.950165 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.950393 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.950481 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.950746 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.950852 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.951094 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.951194 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.951424 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.951516 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.951735 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.951823 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.952044 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.952144 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.952359 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.952445 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.952662 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.952756 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.952966 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.953579 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.953811 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.953901 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.954125 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.954213 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.954439 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.954535 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.954749 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.954854 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.955083 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.955169 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.955402 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.955542 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.955720 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.955810 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.956028 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.956249 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.956350 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.956586 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.956674 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.956908 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.956996 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.957241 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.957331 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.957549 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.957635 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.957861 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.957957 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.958166 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.958254 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.958474 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.958562 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.958780 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.958895 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.959114 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.959213 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.959424 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.959512 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.959732 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.959829 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.960037 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.960132 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.960347 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.960434 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.960654 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.960749 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.960961 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.961049 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.961273 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.961362 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.961585 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.961682 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.961898 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.961987 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.962212 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.962307 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.962520 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.962615 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.962856 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.962949 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.963162 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.963250 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.963476 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.963571 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.963802 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.963897 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.964120 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.964211 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.964437 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.964526 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.964754 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.964850 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.965074 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.965170 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.965389 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.965611 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.965698 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.965948 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.966036 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.966272 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.966369 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.966598 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.966724 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.966950 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.967053 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.967262 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.967351 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.967566 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.967654 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.967876 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.968205 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.968304 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.968523 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.968630 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.969397 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.969488 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.969717 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.969819 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.970028 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.970116 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.970339 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.970426 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.970653 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.970743 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.971004 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.971094 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.971322 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.971411 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.971632 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.971720 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.971943 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.972030 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.972259 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.972346 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.972574 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.972669 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.972888 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.972975 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.973200 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.973295 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.973510 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.973599 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.973818 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.973907 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.974131 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.974230 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.974450 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.974555 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.974762 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.974898 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.975092 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.975194 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.975396 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.975484 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.975709 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.975794 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.976012 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.976101 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.976317 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.976412 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.976622 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.976711 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.976927 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.977016 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.977236 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.977324 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.977539 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.977625 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.977891 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.978146 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.978235 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.978448 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.978536 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.978752 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.978870 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.979080 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.979176 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.979396 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.979483 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.979702 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.979799 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.980008 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.980096 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.980315 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.980403 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.980620 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.980709 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.980926 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.981014 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.981258 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.981346 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.981590 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.981679 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.981906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.981995 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.982232 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.982328 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.982546 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.982642 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.982875 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.982966 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.983187 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.983285 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.983502 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.983589 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.983820 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.983906 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.984134 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.984250 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.984478 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.984574 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.984786 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.985011 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.985098 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.985396 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.985510 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.985704 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.985907 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.985998 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.986230 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.986320 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.986547 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.986636 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.986899 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.986989 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.987210 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.987299 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.987517 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.987606 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.987823 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.987910 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.988128 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.988218 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.988434 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.988531 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.988745 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.988906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.989055 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.989143 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.989361 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.989448 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.989671 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.989771 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.989978 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.990075 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.990282 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.990370 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.990615 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.990712 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.990957 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.991049 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.991277 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.991377 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.991594 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.991693 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.991909 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.991996 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.992230 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.992317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.992539 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.992641 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.992860 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.992962 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.993181 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.993268 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.993501 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.993599 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.993818 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.993906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.994129 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.994217 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.994461 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.994555 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.994775 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.994879 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.995120 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.995221 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.995436 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.995532 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.995789 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.996123 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.996222 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.996443 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.996534 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.996763 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.996858 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.997075 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.997164 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.997323 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:17:35.997415 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.997719 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.998049 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.998380 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.998707 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.999053 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.999393 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:35.999713 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.000059 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.000377 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.000696 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.001013 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.001336 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.001653 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.005895 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.006266 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.006891 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.007536 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.007997 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.008342 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.008700 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.009061 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.009717 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.010318 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.011020 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.011645 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.011999 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.012343 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.012675 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:17:36.013035 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:17:36.150477 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Registered counter for database nova_api Sep 24 14:17:36.171272 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.176951 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO dbcounter [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Registered counter for database nova_api Sep 24 14:17:36.178711 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.197111 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.204161 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writer thread running {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.235505 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.context [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76c0b987-cac9-4795-a959-19f9a0a44deb(cell1) {{(pid=105512) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:17:36.239316 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:17:36.239782 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:17:36.241329 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:17:36.242040 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:17:36.242478 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:17:36.244487 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:17:36.246469 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Registered counter for database nova_cell0 Sep 24 14:17:36.251030 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Registered counter for database nova_cell1 Sep 24 14:17:36.258726 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.260118 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.context [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76c0b987-cac9-4795-a959-19f9a0a44deb(cell1) {{(pid=105511) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:17:36.261134 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.264021 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_concurrency.lockutils [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:17:36.264499 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_concurrency.lockutils [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:17:36.266653 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_concurrency.lockutils [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:17:36.266927 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.267408 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_concurrency.lockutils [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:17:36.267857 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_concurrency.lockutils [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:17:36.269846 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_concurrency.lockutils [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:17:36.271865 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO dbcounter [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Registered counter for database nova_cell0 Sep 24 14:17:36.272113 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.275905 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO dbcounter [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Registered counter for database nova_cell1 Sep 24 14:17:36.283510 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.287263 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.289061 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writer thread running {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.412847 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO dbcounter [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Registered counter for database nova_cell0 Sep 24 14:17:36.419699 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_db.sqlalchemy.engines [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.424805 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writer thread running {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.429629 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writer thread running {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.438347 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO dbcounter [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Registered counter for database nova_cell0 Sep 24 14:17:36.445131 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:17:36.450491 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writer thread running {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:17:36.762019 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:17:36.767639 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: WARNING keystonemiddleware.auth_token [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:17:36.769323 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:17:36.775458 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: WARNING keystonemiddleware.auth_token [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:17:37.111903 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:17:37.117762 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: WARNING keystonemiddleware.auth_token [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:17:37.118628 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: WARNING keystonemiddleware.auth_token [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:17:37.123148 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c7574b9c0 pid: 105512 (default app) Sep 24 14:17:37.124585 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: WARNING keystonemiddleware.auth_token [None req-1fe08358-9e18-4c97-9696-9e464df5768b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:17:37.125275 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:17:37.126446 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001785 Sep 24 14:17:37.126875 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Sat Sep 24 14:17:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:17:37.129881 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c7574b9c0 pid: 105511 (default app) Sep 24 14:18:58.373737 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:18:58.374754 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 24 14:18:58.375179 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:18:58.387712 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_api:SELECT=3 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:58.388821 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_cell0:SELECT=3 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:58.389532 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_cell1:SELECT=3 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:58.390670 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_cell0:SELECT=3 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:59.271860 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-60da7c45-1230-4661-a023-b393a3a5cf99 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:18:59.304799 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-60da7c45-1230-4661-a023-b393a3a5cf99 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922710 Sep 24 14:18:59.305539 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 14:18:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:01.901403 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:01.902995 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-d0834015-0924-4aec-815d-8110dfdad43c None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 Sep 24 14:19:01.903982 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:02.380870 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-9ea11db0-2072-4395-86bc-202d66fb95d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "name": "cirros256", "vcpus": 1}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:02.430029 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-9ea11db0-2072-4395-86bc-202d66fb95d0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.520083 Sep 24 14:19:02.430586 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:02.447942 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=3 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:02.449498 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell1:SELECT=3 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:02.451852 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell0:SELECT=3 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:02.452649 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:02.660577 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-372e74bc-0e6a-4de5-80ff-968b4aadd629 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:02.727774 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-372e74bc-0e6a-4de5-80ff-968b4aadd629 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285196 Sep 24 14:19:02.728368 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 14:19:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:19:05.351011 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-9ea11db0-2072-4395-86bc-202d66fb95d0 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:05.352029 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-9ea11db0-2072-4395-86bc-202d66fb95d0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 24 14:19:05.352428 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:06.009314 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-a8bd35bf-59b4-4902-af18-750e8f03e9c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds512M"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:06.051739 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-a8bd35bf-59b4-4902-af18-750e8f03e9c7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.692625 Sep 24 14:19:06.054890 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:06.065556 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-4e080931-2cd0-41be-a987-25260fe0309f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:06.104034 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-4e080931-2cd0-41be-a987-25260fe0309f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042816 Sep 24 14:19:06.105103 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 14:19:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:08.748643 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-a8bd35bf-59b4-4902-af18-750e8f03e9c7 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:08.749910 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-a8bd35bf-59b4-4902-af18-750e8f03e9c7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Sep 24 14:19:08.750337 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:09.177913 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-a749a70d-0848-4654-8c19-8e856a79d4cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:09.202117 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-a749a70d-0848-4654-8c19-8e856a79d4cf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444319 Sep 24 14:19:09.202896 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:09.215192 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-94c59e05-ca2a-433d-89fc-c389eeffac3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:09.244267 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-94c59e05-ca2a-433d-89fc-c389eeffac3b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033132 Sep 24 14:19:09.244837 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 14:19:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:11.874074 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-a749a70d-0848-4654-8c19-8e856a79d4cf admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:11.875114 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-a749a70d-0848-4654-8c19-8e856a79d4cf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 24 14:19:11.875690 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:12.284471 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-83e3bfa9-e325-4a6c-8560-2612913dbc4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:12.306398 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-83e3bfa9-e325-4a6c-8560-2612913dbc4e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424670 Sep 24 14:19:12.307320 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:12.319083 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-cb678545-302a-4b83-b7b5-59a9ae237366 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:12.347592 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-cb678545-302a-4b83-b7b5-59a9ae237366 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032062 Sep 24 14:19:12.349427 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 14:19:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:14.991634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-83e3bfa9-e325-4a6c-8560-2612913dbc4e admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:14.992695 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-83e3bfa9-e325-4a6c-8560-2612913dbc4e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Sep 24 14:19:14.993098 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:19:15.396080 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-0d23a436-1834-4f4d-916a-6c7cd09326ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "name": "ds4G"}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:15.414529 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-0d23a436-1834-4f4d-916a-6c7cd09326ef admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.414733 Sep 24 14:19:15.415070 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 14:19:15.427047 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-a37a8e5a-05af-4b8d-bf0b-ee53e31c421b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:15.451251 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-a37a8e5a-05af-4b8d-bf0b-ee53e31c421b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027830 Sep 24 14:19:15.451807 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Sat Sep 24 14:19:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:18.097956 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-0d23a436-1834-4f4d-916a-6c7cd09326ef admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:18.099012 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-0d23a436-1834-4f4d-916a-6c7cd09326ef admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 24 14:19:18.099410 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:18.501329 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-6e0a20e6-ba90-419b-a8db-04c0c2223149 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:18.529079 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-6e0a20e6-ba90-419b-a8db-04c0c2223149 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.422975 Sep 24 14:19:18.529555 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 14:19:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:19:21.150805 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-0d23a436-1834-4f4d-916a-6c7cd09326ef admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:21.151850 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-0d23a436-1834-4f4d-916a-6c7cd09326ef admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 24 14:19:21.152257 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:21.564719 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-371022f4-89bb-43f1-a567-1918ebd5451e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:21.585340 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-371022f4-89bb-43f1-a567-1918ebd5451e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426657 Sep 24 14:19:21.585886 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:21.598193 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-b9c0a649-c912-42ec-b09d-c100ac4c141c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:21.627056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-b9c0a649-c912-42ec-b09d-c100ac4c141c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032525 Sep 24 14:19:21.627807 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 14:19:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:24.228681 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-371022f4-89bb-43f1-a567-1918ebd5451e admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:24.229717 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-371022f4-89bb-43f1-a567-1918ebd5451e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 24 14:19:24.230417 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:24.638767 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-303cc58e-ce1c-4581-945e-faee46dc77d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:24.657306 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-303cc58e-ce1c-4581-945e-faee46dc77d9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420984 Sep 24 14:19:24.657887 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:24.670205 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-3789b900-c0b2-4a16-9aa2-3e67438205d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:24.693544 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-3789b900-c0b2-4a16-9aa2-3e67438205d4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027402 Sep 24 14:19:24.694120 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 14:19:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:27.323732 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-303cc58e-ce1c-4581-945e-faee46dc77d9 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:27.324843 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-303cc58e-ce1c-4581-945e-faee46dc77d9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002695 Sep 24 14:19:27.325240 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:27.762260 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-780d4a46-7b96-47b5-975f-2662345f33d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:27.783663 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-780d4a46-7b96-47b5-975f-2662345f33d3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.452300 Sep 24 14:19:27.786342 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:27.798268 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-4b3ca9dd-ee49-4bb9-b578-8877a8272cca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:27.829813 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-4b3ca9dd-ee49-4bb9-b578-8877a8272cca admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035162 Sep 24 14:19:27.835342 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 14:19:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:30.495464 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-780d4a46-7b96-47b5-975f-2662345f33d3 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:30.497255 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-780d4a46-7b96-47b5-975f-2662345f33d3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002764 Sep 24 14:19:30.497734 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:30.960010 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-98063081-ac58-44d7-a327-6f2e098e113b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:30.967538 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:30.983778 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-98063081-ac58-44d7-a327-6f2e098e113b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480031 Sep 24 14:19:30.984451 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 14:19:30.999635 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-6843cea1-2c5c-4486-90f5-a9494ebc2960 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:31.025883 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-6843cea1-2c5c-4486-90f5-a9494ebc2960 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032908 Sep 24 14:19:31.026673 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 14:19:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:33.664986 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-98063081-ac58-44d7-a327-6f2e098e113b admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:33.666003 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-98063081-ac58-44d7-a327-6f2e098e113b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 24 14:19:33.667370 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:34.100118 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-5747e1c8-e2ad-4dfa-b4b8-f577e83ffe3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "id": "5"}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:34.107257 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:34.122475 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-5747e1c8-e2ad-4dfa-b4b8-f577e83ffe3a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449068 Sep 24 14:19:34.123357 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Sat Sep 24 14:19:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:19:34.137056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-b6e8c8f4-c704-4646-ae0d-ddf6e0e8d5ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:19:34.161262 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-b6e8c8f4-c704-4646-ae0d-ddf6e0e8d5ea admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028722 Sep 24 14:19:34.161852 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Sat Sep 24 14:19:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:19:52.371073 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-5747e1c8-e2ad-4dfa-b4b8-f577e83ffe3a admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:52.372093 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-5747e1c8-e2ad-4dfa-b4b8-f577e83ffe3a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 24 14:19:52.372500 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:52.382774 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:52.773065 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-3e6300d2-eca7-46ba-a566-dff026b88122 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:52.795032 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-3e6300d2-eca7-46ba-a566-dff026b88122 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.416610 Sep 24 14:19:52.795564 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 14:19:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:19:54.099287 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-5747e1c8-e2ad-4dfa-b4b8-f577e83ffe3a admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:54.100289 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-5747e1c8-e2ad-4dfa-b4b8-f577e83ffe3a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 24 14:19:54.100685 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:54.624844 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-c6301418-8cf4-4614-8f20-9e5c5574d4e5 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:54.630074 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.wsgi [None req-c6301418-8cf4-4614-8f20-9e5c5574d4e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-c6301418-8cf4-4614-8f20-9e5c5574d4e5 admin admin] Request method failure captured: Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Accept: application/json Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Accept-Encoding: gzip, deflate Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Connection: keep-alive Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Content-Length: 0 Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Host: 10.222.0.52 Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Openstack-Api-Version: compute 2.92 Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Openstack-System-Scope: None Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: User-Agent: python-novaclient Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Auth-Token: gAAAAABjLxIJW3V5ENvgSHswLkY4HITRZ6RdNzrIfp2A6qX_1AXyoi8o59JtrJmAPCpQDXUOERJ5Gh-_WS49GXeDC_cg6iLcOMgmbQRk7G_j_azHiLpXqP0jvEu5wrhrsBl-3UILkDI6UE211l1a0TGU_a51GRQdzal-QKfdcZYQmdQoa5sY0e4 Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Domain-Id: None Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Domain-Name: None Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Identity-Status: Confirmed Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Is-Admin-Project: True Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Domain-Id: default Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Domain-Name: Default Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Name: admin Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Role: admin,member,reader Sep 24 14:19:54.633317 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Roles: admin,member,reader Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f8134960517435ea813cbf2d41e25d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f8134960517435ea813cbf2d41e25d7"}]}] Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant: admin Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant-Name: admin Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User: admin Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Domain-Id: default Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Domain-Name: Default Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Id: a6fda065d398415a9b8308457ab0f0dc Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Name: admin Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: method: > Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: exception: Flavor 42 could not be found. Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: action_args: {'id': '42'} Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:19:54.635475 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:54.636627 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.638056 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-c6301418-8cf4-4614-8f20-9e5c5574d4e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:19:54.639359 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-c6301418-8cf4-4614-8f20-9e5c5574d4e5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394720 Sep 24 14:19:54.639359 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 14:19:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:54.645641 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-4eec1a12-fb5d-4617-815f-0ae0c644449e admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:54.668181 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-4eec1a12-fb5d-4617-815f-0ae0c644449e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026623 Sep 24 14:19:54.668721 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 14:19:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:19:54.679201 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-d39c4162-abac-4018-b623-a41c194ffa13 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:54.700916 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-d39c4162-abac-4018-b623-a41c194ffa13 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026180 Sep 24 14:19:54.701445 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 14:19:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:19:54.710930 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-e4c782b2-a728-4f5e-8836-c00b72337738 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:54.716677 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.wsgi [None req-e4c782b2-a728-4f5e-8836-c00b72337738 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-e4c782b2-a728-4f5e-8836-c00b72337738 admin admin] Request method failure captured: Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Accept: application/json Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Accept-Encoding: gzip, deflate Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Connection: keep-alive Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Content-Length: 0 Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Host: 10.222.0.52 Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Openstack-Api-Version: compute 2.92 Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Openstack-System-Scope: None Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: User-Agent: python-novaclient Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Auth-Token: gAAAAABjLxIJW3V5ENvgSHswLkY4HITRZ6RdNzrIfp2A6qX_1AXyoi8o59JtrJmAPCpQDXUOERJ5Gh-_WS49GXeDC_cg6iLcOMgmbQRk7G_j_azHiLpXqP0jvEu5wrhrsBl-3UILkDI6UE211l1a0TGU_a51GRQdzal-QKfdcZYQmdQoa5sY0e4 Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Domain-Id: None Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Domain-Name: None Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Identity-Status: Confirmed Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Is-Admin-Project: True Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Domain-Id: default Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Domain-Name: Default Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Name: admin Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Role: admin,member,reader Sep 24 14:19:54.719906 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Roles: admin,member,reader Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f8134960517435ea813cbf2d41e25d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f8134960517435ea813cbf2d41e25d7"}]}] Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant: admin Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant-Name: admin Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User: admin Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Domain-Id: default Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Domain-Name: Default Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Id: a6fda065d398415a9b8308457ab0f0dc Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Name: admin Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: method: > Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: exception: Flavor 42 could not be found. Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: action_args: {'id': '42'} Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:19:54.721432 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:54.722312 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:54.723436 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-e4c782b2-a728-4f5e-8836-c00b72337738 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:19:54.724456 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-e4c782b2-a728-4f5e-8836-c00b72337738 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014134 Sep 24 14:19:54.724456 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 14:19:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:55.938636 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-d39c4162-abac-4018-b623-a41c194ffa13 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:55.939652 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-d39c4162-abac-4018-b623-a41c194ffa13 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 24 14:19:55.940040 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:56.456557 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-9c0df8e7-3dc1-431d-9618-96ce5cb26321 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:56.461606 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.wsgi [None req-9c0df8e7-3dc1-431d-9618-96ce5cb26321 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-9c0df8e7-3dc1-431d-9618-96ce5cb26321 admin admin] Request method failure captured: Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Accept: application/json Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Accept-Encoding: gzip, deflate Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Connection: keep-alive Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Content-Length: 0 Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Host: 10.222.0.52 Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Openstack-Api-Version: compute 2.92 Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Openstack-System-Scope: None Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: User-Agent: python-novaclient Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Auth-Token: gAAAAABjLxILDavr7T8hAce7Szbm0ozOIpbKiv3CTs6uBqcfBC79IHn9moakgAYaNq92FWpqTA9Q1WquyRdbRPfGJYPULrHhmXS706-Tx6DtsqSJGFgy7aprt8jhRB5EfNEexCOyV2xmEXby385dMz_MdhjYXFrwBi0UUAyDZtXzbjUIQoyI9oQ Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Domain-Id: None Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Domain-Name: None Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Identity-Status: Confirmed Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Is-Admin-Project: True Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Domain-Id: default Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Domain-Name: Default Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Name: admin Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Role: admin,member,reader Sep 24 14:19:56.463180 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Roles: admin,member,reader Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f8134960517435ea813cbf2d41e25d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f8134960517435ea813cbf2d41e25d7"}]}] Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant: admin Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant-Name: admin Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User: admin Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Domain-Id: default Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Domain-Name: Default Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Id: a6fda065d398415a9b8308457ab0f0dc Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Name: admin Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: method: > Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: exception: Flavor 84 could not be found. Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: action_args: {'id': '84'} Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:19:56.464704 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:56.465634 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.467145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-9c0df8e7-3dc1-431d-9618-96ce5cb26321 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:19:56.468481 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-9c0df8e7-3dc1-431d-9618-96ce5cb26321 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387341 Sep 24 14:19:56.468481 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 14:19:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:56.474285 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-59dfc797-cf9d-4a51-b986-640578931c43 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:56.489078 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-59dfc797-cf9d-4a51-b986-640578931c43 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018254 Sep 24 14:19:56.489520 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 14:19:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:19:56.499140 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-5868dc40-9165-4752-92d0-b34b1a960786 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:56.514767 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-5868dc40-9165-4752-92d0-b34b1a960786 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019096 Sep 24 14:19:56.515314 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 14:19:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:19:56.524168 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-79060c83-d18f-420c-8938-1fc29af5de9a admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:56.529504 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.wsgi [None req-79060c83-d18f-420c-8938-1fc29af5de9a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-79060c83-d18f-420c-8938-1fc29af5de9a admin admin] Request method failure captured: Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Accept: application/json Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Accept-Encoding: gzip, deflate Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Connection: keep-alive Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Content-Length: 0 Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Host: 10.222.0.52 Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Openstack-Api-Version: compute 2.92 Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Openstack-System-Scope: None Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: User-Agent: python-novaclient Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Auth-Token: gAAAAABjLxILDavr7T8hAce7Szbm0ozOIpbKiv3CTs6uBqcfBC79IHn9moakgAYaNq92FWpqTA9Q1WquyRdbRPfGJYPULrHhmXS706-Tx6DtsqSJGFgy7aprt8jhRB5EfNEexCOyV2xmEXby385dMz_MdhjYXFrwBi0UUAyDZtXzbjUIQoyI9oQ Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Domain-Id: None Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Domain-Name: None Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Identity-Status: Confirmed Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Is-Admin-Project: True Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Domain-Id: default Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Domain-Name: Default Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Name: admin Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Role: admin,member,reader Sep 24 14:19:56.531051 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Roles: admin,member,reader Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f8134960517435ea813cbf2d41e25d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f8134960517435ea813cbf2d41e25d7"}]}] Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant: admin Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant-Name: admin Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User: admin Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Domain-Id: default Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Domain-Name: Default Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Id: a6fda065d398415a9b8308457ab0f0dc Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Name: admin Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: method: > Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: exception: Flavor 84 could not be found. Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: action_args: {'id': '84'} Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:19:56.532683 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:56.533548 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:56.534991 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-79060c83-d18f-420c-8938-1fc29af5de9a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:19:56.536214 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-79060c83-d18f-420c-8938-1fc29af5de9a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011919 Sep 24 14:19:56.536214 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Sat Sep 24 14:19:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:57.734512 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-5868dc40-9165-4752-92d0-b34b1a960786 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:57.735539 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-5868dc40-9165-4752-92d0-b34b1a960786 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 24 14:19:57.735929 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:19:58.255894 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-c39dbda1-bb6a-4cd3-8dc9-8007d7f0a22b admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:58.262198 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.wsgi [None req-c39dbda1-bb6a-4cd3-8dc9-8007d7f0a22b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-c39dbda1-bb6a-4cd3-8dc9-8007d7f0a22b admin admin] Request method failure captured: Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Accept: application/json Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Accept-Encoding: gzip, deflate Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Connection: keep-alive Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Content-Length: 0 Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Host: 10.222.0.52 Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Openstack-Api-Version: compute 2.92 Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Openstack-System-Scope: None Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: User-Agent: python-novaclient Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Auth-Token: gAAAAABjLxINz3WCvYvCg-nhTHzb4-ZSOpDjR_rHGYIA06uFei3zJYUjrHw-AG6N1QZAqfd9S1b8H_slRTJ8kgiB8yV5hCNkAlKZcwlWYbRdtyG96KJUy9C-fTXSrjutv8tYd1Quf0DHKosjHgtJVso6xINdVKRUzK3fRYwGblauN5zjFlCTg80 Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Domain-Id: None Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Domain-Name: None Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Identity-Status: Confirmed Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Is-Admin-Project: True Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Domain-Id: default Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Domain-Name: Default Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Project-Name: admin Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Role: admin,member,reader Sep 24 14:19:58.263762 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Roles: admin,member,reader Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f8134960517435ea813cbf2d41e25d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f8134960517435ea813cbf2d41e25d7"}]}] Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant: admin Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-Tenant-Name: admin Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User: admin Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Domain-Id: default Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Domain-Name: Default Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Id: a6fda065d398415a9b8308457ab0f0dc Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: X-User-Name: admin Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: method: > Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: exception: Flavor 451 could not be found. Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: action_args: {'id': '451'} Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:19:58.265316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:58.266287 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.267716 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-c39dbda1-bb6a-4cd3-8dc9-8007d7f0a22b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:19:58.268973 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-c39dbda1-bb6a-4cd3-8dc9-8007d7f0a22b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390333 Sep 24 14:19:58.268973 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 14:19:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:58.274840 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-3117dde1-c382-438f-8fa7-38c0ba50a3c0 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:58.290218 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-3117dde1-c382-438f-8fa7-38c0ba50a3c0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018897 Sep 24 14:19:58.290740 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 14:19:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:19:58.299796 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:58.316697 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020099 Sep 24 14:19:58.317462 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Sat Sep 24 14:19:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:19:58.327377 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-def878e1-c263-4dd1-9875-c492e9dd33a9 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:58.332275 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.wsgi [None req-def878e1-c263-4dd1-9875-c492e9dd33a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-def878e1-c263-4dd1-9875-c492e9dd33a9 admin admin] Request method failure captured: Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Accept: application/json Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Accept-Encoding: gzip, deflate Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Connection: keep-alive Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Content-Length: 0 Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Host: 10.222.0.52 Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Openstack-Api-Version: compute 2.92 Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Openstack-System-Scope: None Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: User-Agent: python-novaclient Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Auth-Token: gAAAAABjLxINz3WCvYvCg-nhTHzb4-ZSOpDjR_rHGYIA06uFei3zJYUjrHw-AG6N1QZAqfd9S1b8H_slRTJ8kgiB8yV5hCNkAlKZcwlWYbRdtyG96KJUy9C-fTXSrjutv8tYd1Quf0DHKosjHgtJVso6xINdVKRUzK3fRYwGblauN5zjFlCTg80 Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Domain-Id: None Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Domain-Name: None Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Identity-Status: Confirmed Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Is-Admin-Project: True Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Domain-Id: default Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Domain-Name: Default Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Project-Name: admin Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Role: admin,member,reader Sep 24 14:19:58.333755 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Roles: admin,member,reader Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f8134960517435ea813cbf2d41e25d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f8134960517435ea813cbf2d41e25d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f8134960517435ea813cbf2d41e25d7"}]}] Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant: admin Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant-Id: 2f8134960517435ea813cbf2d41e25d7 Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-Tenant-Name: admin Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User: admin Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Domain-Id: default Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Domain-Name: Default Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Id: a6fda065d398415a9b8308457ab0f0dc Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: X-User-Name: admin Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: method: > Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: exception: Flavor 451 could not be found. Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: action_args: {'id': '451'} Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:19:58.335356 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:58.336493 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: ERROR nova.api.openstack.wsgi Sep 24 14:19:58.338489 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-def878e1-c263-4dd1-9875-c492e9dd33a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:19:58.339930 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-def878e1-c263-4dd1-9875-c492e9dd33a9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011233 Sep 24 14:19:58.339930 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 14:19:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:59.560738 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:19:59.562147 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 24 14:19:59.563216 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:20:00.100232 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-ed8494c6-15bb-4149-a192-49a198360df2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:20:00.120855 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-ed8494c6-15bb-4149-a192-49a198360df2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.413116 Sep 24 14:20:00.121391 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 14:19:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:20:01.331588 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:20:01.333571 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002473 Sep 24 14:20:01.333962 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:20:01.848648 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-b94f7114-9219-46ae-8a14-f696d5f22dd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:20:01.866831 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-b94f7114-9219-46ae-8a14-f696d5f22dd3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.396383 Sep 24 14:20:01.867365 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 14:20:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 14:20:03.190159 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:20:03.191227 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 24 14:20:03.191620 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:20:03.709913 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-a029e00d-0806-468d-9a07-5675f50fa5df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:20:03.728969 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-a029e00d-0806-468d-9a07-5675f50fa5df admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399972 Sep 24 14:20:03.729502 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 14:20:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:20:04.939958 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:20:04.940958 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 24 14:20:04.941354 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:20:05.456337 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-7290751d-04a3-4e1d-be64-5eebae2d43af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:20:05.474885 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-7290751d-04a3-4e1d-be64-5eebae2d43af admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396055 Sep 24 14:20:05.475419 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Sat Sep 24 14:20:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:20:06.695693 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:20:06.696685 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 24 14:20:06.697571 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:20:07.213136 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-99e5c798-c650-4521-a156-33ee691e28f4 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:20:07.233308 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-99e5c798-c650-4521-a156-33ee691e28f4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398136 Sep 24 14:20:07.233833 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Sat Sep 24 14:20:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:21:03.601990 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:21:03.602965 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-748ed7d8-66f5-4d47-84a8-c0a40a3978db admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 24 14:21:03.603400 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Sat Sep 24 14:21:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:21:03.614000 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:03.996703 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-53652341-1a26-45f6-950b-850ff5abd581 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:21:04.017499 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-53652341-1a26-45f6-950b-850ff5abd581 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408306 Sep 24 14:21:04.018029 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Sat Sep 24 14:21:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:21:04.038875 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_api:SELECT=14 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:04.042506 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-a26ed38d-d16d-4cf7-803b-07f08fc26a4e admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:21:04.049590 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-a26ed38d-d16d-4cf7-803b-07f08fc26a4e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012142 Sep 24 14:21:04.050102 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Sat Sep 24 14:21:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:21:04.061781 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-8c33bb04-bccb-4467-8854-77b89e87bace admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:21:04.068937 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-8c33bb04-bccb-4467-8854-77b89e87bace admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010707 Sep 24 14:21:04.069450 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Sat Sep 24 14:21:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:21:04.081083 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:21:04.088186 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010536 Sep 24 14:21:04.088697 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Sat Sep 24 14:21:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:21:04.099507 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-dbd85e64-0a70-478f-8953-f4215f6607b1 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:21:04.106576 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-dbd85e64-0a70-478f-8953-f4215f6607b1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010498 Sep 24 14:21:04.107162 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Sat Sep 24 14:21:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:24:06.957873 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:06.958907 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 24 14:24:06.959301 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:24:07.100896 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=6 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:07.256891 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:07.262037 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:07.262513 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:07.262973 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:07.263684 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:07.264131 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:07.264547 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:07.295595 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-d0e64262-2315-4194-a431-16a3676f3324 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.195958 Sep 24 14:24:07.296145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 14:24:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:24:08.380310 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:08.381310 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 24 14:24:08.381701 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:24:08.587641 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:08.591071 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:08.591543 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:08.591966 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:08.592673 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:08.593145 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:08.593562 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:08.613031 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-a14559ab-dd1c-47b5-bf47-3c521bbf7c21 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.082684 Sep 24 14:24:08.613586 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 14:24:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:24:20.093307 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:20.094316 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 24 14:24:20.094710 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:24:20.240394 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell0:SELECT=4 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:20.241103 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_cell1:SELECT=4 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:20.241712 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG dbcounter [-] [105512] Writing DB stats nova_api:SELECT=8 {{(pid=105512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:20.288672 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:20.292613 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:20.293121 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:20.293551 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:20.294264 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:20.294711 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:20.295155 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:20.319401 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-4c4436bc-b020-43c2-b171-e1ac0a6cac99 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.083430 Sep 24 14:24:20.319940 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 14:24:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:24:21.400508 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG nova.api.openstack.wsgi [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] Calling method '>' {{(pid=105511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:21.401544 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: INFO nova.api.openstack.requestlog [None req-8eb6e3d3-d295-46da-b947-4fbae567f487 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 24 14:24:21.401933 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: [pid: 105511|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Sat Sep 24 14:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:24:21.591181 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG nova.api.openstack.wsgi [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] Calling method '>' {{(pid=105512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:24:21.594558 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:21.595055 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:21.595485 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:21.596195 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:24:21.596641 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:24:21.597052 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: DEBUG oslo_concurrency.lockutils [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:24:21.618692 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: INFO nova.api.openstack.requestlog [None req-cc0004ee-ecbd-48fc-879e-a48107c314f0 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.077876 Sep 24 14:24:21.619235 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: [pid: 105512|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Sat Sep 24 14:24:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:25:20.939402 dv-cinder-859193-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 24 14:25:20.939863 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: Sat Sep 24 14:25:20 2022 - graceful shutdown triggered... Sep 24 14:25:20.940327 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: Gracefully killing worker 1 (pid: 105511)... Sep 24 14:25:20.940741 dv-cinder-859193-1-iscsi devstack@n-api.service[105512]: Gracefully killing worker 2 (pid: 105512)... Sep 24 14:25:21.065463 dv-cinder-859193-1-iscsi devstack@n-api.service[105511]: DEBUG dbcounter [-] [105511] Writing DB stats nova_api:SELECT=4 {{(pid=105511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:25:21.940843 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: worker 1 buried after 1 seconds Sep 24 14:25:21.941318 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: worker 2 buried after 1 seconds Sep 24 14:25:21.941318 dv-cinder-859193-1-iscsi devstack@n-api.service[105510]: goodbye to uWSGI. Sep 24 14:25:21.942443 dv-cinder-859193-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 24 14:25:21.943019 dv-cinder-859193-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 24 14:25:21.945810 dv-cinder-859193-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 14:25:21.956296 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 14:25:21 2022] *** Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: nodename: dv-cinder-859193-1-iscsi Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: machine: x86_64 Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: clock source: unix Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: pcre jit disabled Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: detected number of CPU cores: 4 Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: current working directory: / Sep 24 14:25:21.958287 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: detected binary path: /usr/bin/uwsgi-core Sep 24 14:25:21.959016 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: your processes number limit is 47680 Sep 24 14:25:21.959016 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: your memory page size is 4096 bytes Sep 24 14:25:21.959016 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: detected max file descriptor number: 2048 Sep 24 14:25:21.959016 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: lock engine: pthread robust mutexes Sep 24 14:25:21.959016 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: thunder lock: enabled Sep 24 14:25:21.959016 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 14:25:21.959016 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 14:25:21.999052 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: Python main interpreter initialized at 0x55d4247179c0 Sep 24 14:25:21.999052 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: python threads support enabled Sep 24 14:25:21.999052 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: your server socket listen backlog is limited to 100 connections Sep 24 14:25:21.999052 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: your mercy for graceful operations on workers is 90 seconds Sep 24 14:25:21.999508 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 14:25:21.999508 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: *** Operational MODE: preforking *** Sep 24 14:25:21.999763 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: *** uWSGI is running in multiple interpreter mode *** Sep 24 14:25:21.999763 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: spawned uWSGI master process (pid: 120728) Sep 24 14:25:21.999970 dv-cinder-859193-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 14:25:22.001882 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: spawned uWSGI worker 1 (pid: 120743, cores: 1) Sep 24 14:25:22.001882 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: spawned uWSGI worker 2 (pid: 120744, cores: 1) Sep 24 14:25:22.001882 dv-cinder-859193-1-iscsi devstack@n-api.service[120728]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 14:25:22.660339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:25:22.667353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:25:23.818771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:25:23.818771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: from cryptography.utils import int_from_bytes Sep 24 14:25:23.818771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:25:23.818771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: from cryptography.utils import int_from_bytes Sep 24 14:25:23.841432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:25:23.841432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: from cryptography.utils import int_from_bytes Sep 24 14:25:23.841935 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:25:23.841935 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: from cryptography.utils import int_from_bytes Sep 24 14:25:26.256511 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:25:26.257099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:25:26.257361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:25:26.257731 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:25:26.257990 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:25:26.258382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.258709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.259062 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.259385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.260250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.260562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.260887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.261208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.261535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.261797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.262109 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.262599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-1-iscsi {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.262949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.263262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.263575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.263955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.264268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.264641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.264924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.265432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.266187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.266692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.267036 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.267386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.267708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.268020 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.268345 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.268659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.268992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.269305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.269721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-1-iscsi {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.270041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.270363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.270692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.271193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.271507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.271852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.272191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.272532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.272840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.273168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.273486 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.273805 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.274137 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.274463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.274804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.275722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.276079 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.276425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.276798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.277052 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.277393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.277718 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.278134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.278388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.278643 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.278919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.279241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.279560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.279867 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.280174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.280487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.280791 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.281096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.281399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.281701 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.282004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.282319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.282631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.282975 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.283283 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.283862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.284254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.284502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.284808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.285145 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.285462 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.285766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.286083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.286401 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.286503 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:25:26.286947 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:25:26.287029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.287029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.287228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:25:26.287338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.287596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:25:26.287708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.287854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:25:26.287962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.288217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.288319 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.288462 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.288568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.288750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.288862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.289052 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.289177 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.289367 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.289510 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.289671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.289819 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.289968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.290140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.290269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.290461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.290588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.290878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.290999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.291115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.291212 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.291412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.291523 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.291784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.291885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-1-iscsi {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.292086 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.292179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.292391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.292513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.292689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.292784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.292992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.293087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.293292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.293399 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.293592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.293692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.293909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.294011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.294227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.294452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.294568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.294765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.294904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.295100 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.295223 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.295414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.295529 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.295742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.295844 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.296048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.296149 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.296352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.296446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.296672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.296775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.296975 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.297092 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.297279 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.297382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.297635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.297739 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.297948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.298256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.298576 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.298779 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-1-iscsi {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.299000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.299162 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.299259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.299452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.299570 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.299787 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.299892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.300124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.300229 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.300436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.300554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.300743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.300843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.301046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.301154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.301351 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.301450 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.301653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.301753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.301957 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.302066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.303670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.303820 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.303943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304167 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304422 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304878 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.304964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.305060 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.305157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.305245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.305342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.305454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.305454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.305691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.305691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.305864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.305864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.306027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.306121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.306217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.306305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.306389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.306506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.306602 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.306859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.307011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.307147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.307276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.307437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.307534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.307822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.307926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.308133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.308227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.308442 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.308536 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.308754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.308860 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.309065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.309160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.309374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.309484 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.309684 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.309789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.309993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.310094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.310302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.310410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.310613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.310746 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.310950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.311094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.311278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.311386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.311589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.311691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.311901 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.312002 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.312244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.312361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.312611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.312725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.312848 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.312951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.313187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.313291 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.313506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.313775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.313886 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.313985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.314113 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.314214 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.314421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.314522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.314730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.314878 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.315065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.315169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.315373 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.315466 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.315689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.315784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.316004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.316098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.316316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.316407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.316569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.316672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.316873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.316965 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.317178 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.317279 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.317498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.317603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.317804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.317904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.318116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.318208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.318424 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.318532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.318726 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.318857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.319061 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.319166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.319369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.319471 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.319676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.319768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.319985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.320084 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.320290 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.320398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.320597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.320697 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.320899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.320999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.321199 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.321299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.321501 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.321593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.321805 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.321896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.322623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.322754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.322967 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.323064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.323278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.323387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.323641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.323955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.323955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.324133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.324269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.324409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.324583 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.325268 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.325385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.325477 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.325562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.325643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.325723 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.325796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.325868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.325946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.326087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.326265 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.326412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.326587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.326737 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.326919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.327077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.327234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.327385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.327555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.327708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.327861 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.328015 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.328171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.328319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.330976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.331082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.331173 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.331251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.331326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.331405 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.331485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.331573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.331659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.331740 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.331819 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.331898 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.331971 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.332048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.332133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.332214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.332286 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.332356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.332426 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.332506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.332578 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.332656 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.332728 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.332808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.332908 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.332994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.333073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.333145 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.333215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.333315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.333391 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:25:26.333476 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.333555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.333628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.333706 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.333787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.334281 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.334394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.334469 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.334547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.334629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.334703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.334926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.335025 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.335234 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.335347 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.335542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.335642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.335845 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.335946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.336165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.336266 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.336475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.336587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.336782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.336882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.337300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.337400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.337482 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.337555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.338352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.338459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.338649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.338741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.338999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.339105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.339335 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.339429 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.339609 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.339700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.339873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.339977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.340901 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341257 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341713 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.341798 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.342335 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.342440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.342515 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.342586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.342671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.342744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343357 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343605 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343707 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343890 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.343981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.344169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.344274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.344483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.344595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.344853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.344954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.345178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.345256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.345499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.345594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.345765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.345864 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.346105 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.346233 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.346416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.346517 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.346698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.346804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.347057 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.347231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.347382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.347529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.347684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.347913 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.348077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.348239 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.348388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.348542 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.348697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.348889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.349054 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.349225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.349382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.349537 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.349685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.349832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.349979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.350141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.350320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.350674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.350932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.351168 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.351337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.351497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.351645 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.351794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.351940 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.352087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.352245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.352403 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.352559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.352715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.352870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.353019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.353256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.353413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.353573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.353721 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.353876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.354025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.354181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.354339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.354487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.354643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.354805 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.354997 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.355155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.355311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.355460 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.355626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.355784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.355942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.356098 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.356337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.356501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.356650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.356805 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.356967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.357123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.357279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.357428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.357755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.357945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.358179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.358341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.358492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.358649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.359065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.359251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.359402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.359557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.359712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.359868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.360017 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.360186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.360349 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.360510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.360881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.361038 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.361211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.361454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.361454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.361755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.361755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.362041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.362190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.362347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.362347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.362658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.362834 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.362990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.363150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.363299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.363446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.363593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.363741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.363895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.364053 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.364209 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.364356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.364525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.364674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.364822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.364822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.365124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.365279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.365434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.365582 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.365729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.365887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.366042 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.366190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.366355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.366585 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.366757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.366945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.367096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.367243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.367397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.367552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.367710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.367901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.368063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.368318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.368473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.368473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.368784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.368942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.369142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.369142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.369431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.369587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.369745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.369894 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.370091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.370240 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.370404 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.370565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.370750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.371135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.371311 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.371489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.371722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.371876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.372023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.372173 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.372328 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.372489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.372639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.372794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.372948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.373108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.373265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.373424 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.373572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.373719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.373873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.374030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.374189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.374339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.374495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.374644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.374791 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.374962 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.375138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.375297 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.375446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.375600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.375756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.375905 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.376062 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.376218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.376367 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.376367 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.376905 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.377061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.377221 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.377382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.377531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.377687 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.377843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.378001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.378150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.378327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.378563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.378717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.378884 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.379050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.380215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.380215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.380215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.380215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.380215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.380215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.380215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.381538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.381688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.381688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.382103 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.382260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.382408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.382565 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.382722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.382917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.383084 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.383235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.383235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.383545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.383708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.383708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.384000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.384148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.384296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.384936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.385104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.385253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.385401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.385547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.385547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.385838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.386001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.386162 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.386318 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.386467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.386622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.386622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.387066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.387225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.387375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.387530 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.387679 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.387827 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.388055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.388218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.388375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.388549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.388782 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.388952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.389110 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.389305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.389468 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.389617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.389773 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.390055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.390234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.390402 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.390563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.390712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.390889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.391055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.391206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.391579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.391736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.391885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.392143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.392309 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.392467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.392616 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.392765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.392932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.393093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.393242 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.393400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.393550 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.393705 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.393860 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.394023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.394174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.394329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.394478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.394478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.394768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.395005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.395165 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.395322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.395477 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.395633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.395791 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.396024 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.396184 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.396333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.396487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.396637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.396795 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.397036 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.397204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.397354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.397502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.397650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.397810 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.397961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.398110 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.398258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.398407 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.398562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.398727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.398984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.399162 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.399356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.399520 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.399669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.399826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.399975 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.400750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.400911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.401059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.401219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.401368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.401743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.401910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.402501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.402670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.402855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.403011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.403170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.403326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.403475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.403624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.403781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.403930 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.404085 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.404239 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.404427 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.404598 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.404763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.404912 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.405059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.405059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.405354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.405512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.405672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.405827 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.405983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.406132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.406289 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.406452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.406619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.406778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.407047 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.407287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.407287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.407577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.407735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.407883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.408039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.408203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.408353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.408501 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.408919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.409161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.409332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.409527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.409682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.409848 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.410014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.410164 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.410333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.410484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.410647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.410830 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.410987 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.411216 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.411386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.411544 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.411943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.412110 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.412562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.412729 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.412895 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.413054 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.413210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.413359 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.413515 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.413674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.413674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.413990 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.414140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.414297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.414446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.414603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.414753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.414941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.415104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.415261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.415409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.415566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.415751 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.415925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.416075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.416224 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.416378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.416536 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.416686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.416834 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.416997 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.417155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.417407 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.417564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.417713 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.417880 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.418029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.418177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.418337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.418494 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.418494 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.418775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.418775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.419082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.419082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.419479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.419681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.419838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.419998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.420155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.420315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.420464 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.420619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.420775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.420934 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.421093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.421093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.421376 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.421524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.421679 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.422057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.422253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.422415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.422599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.422897 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.423059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.423208 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.423369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.423527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.423685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.423835 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.423997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.424153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.424326 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.424483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.424641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.424790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.424945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.425105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.425254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.425409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.425559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.425714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.425862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.426023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.426181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.426348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.426506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.426656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.426804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.427062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.427222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.427391 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.427617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.427774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.427931 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.428095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.428095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.428980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.429153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.429330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.429575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.429780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.429937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.430086 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.430234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.430382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.430540 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.430696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.430876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.431032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.431191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.431412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.431709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.431882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.432274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.432441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.432607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.432840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.433090 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.433246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.433402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.433551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.433706 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.433877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.434037 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.434194 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.434350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.434499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.434648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.434863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.435024 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.435173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.435332 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.435482 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.435631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.435787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.435956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.436117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.436266 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.436421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.436577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.436735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.436892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.436892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.437176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.437176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.437479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.437479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.437875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.437875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.438459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.438459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.438758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.438758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.439079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.439229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.439378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.439378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.439818 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.439818 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.440119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.440119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.440420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.440570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.440739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.440910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.441059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.441207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.441355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.441512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.441661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.441811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.441966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.442134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.442542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.442708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.442899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.443079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.443317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.443480 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.443640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.443799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.443949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.444097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.444256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.444419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.444570 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.444736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.444894 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.445051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.445262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.445525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.445683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.445833 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.445981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.446129 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.446278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.446436 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.446586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.446742 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.448082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.448245 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.448415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.448574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.448725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.448887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.449064 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.449873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.450053 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.450208 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.450357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.450505 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.450660 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.450908 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.451078 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.451243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.451398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.451547 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.451695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.451852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.452010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.452170 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.452488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.452737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.452903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.453144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.453298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.453447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.453447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.453846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.453996 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.454154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.454303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.454451 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.454451 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.454740 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.454966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.455130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.455291 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.455447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.455596 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.455751 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.455900 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.456063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.456219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.456369 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.456524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.456686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.456686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.456990 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.457147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.457305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.457462 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.457612 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.457612 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.457990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.458223 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.458379 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.458536 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.458692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.458895 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.459182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.459182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.459509 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.459509 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.459811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.460092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.460246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.460395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.460551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.460551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.460853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.461011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.461160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.461327 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.461484 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.461644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.461810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.461968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.462117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.462117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.462567 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.463447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.463615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.463864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.464022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.464022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.464305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.464482 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.464633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.464781 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.464929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.465077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.465233 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.465397 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.465555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.465711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.465868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.466016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.466172 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.466340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.466498 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.466647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.466801 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.466986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.467144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.467144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.467442 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.467592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.467740 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.467888 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.468088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.468342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.468521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.468681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.468830 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.468986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.469148 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.469298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.469453 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.469603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.469759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.470051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.470226 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.470385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.470553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.470553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.471024 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.471197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.471355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.471507 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.471656 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.471806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.471962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.472125 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.472283 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.472439 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.472728 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.472905 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.473056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.473214 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.473382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.473616 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.473771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.474028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.474195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.474345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.474493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.474649 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.477041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.477234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.477428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.477594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.477746 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.477912 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.478065 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.478247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.478470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.478627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.478784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.478784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.479196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.479196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.479196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.479196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.479196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.479196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.480112 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.480353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.480518 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.480676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.480676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.480991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.481216 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.481391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.481546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.481708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.481857 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.482004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.482160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.482319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.482476 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.482634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.482951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.483102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.483252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.483414 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.483572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.483832 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.484027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.484263 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.484431 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.484581 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.484736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.484885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.485041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.485190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.485356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.485505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.485505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.485794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.485794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.486095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.486095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.486389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.486389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.486671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.486846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.487001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.487240 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.487392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.487550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.487707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.487863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.488026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.488187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.488343 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.488493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.488649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.488799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.488955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.489112 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.489269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.489423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.489582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.489731 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.489910 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.490216 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.490216 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.490620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.490771 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.490976 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.491140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.491377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.491542 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.491693 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.491841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.492004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.492161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.492310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.492469 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.492619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.492916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.493090 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.493241 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.493390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.493702 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.493972 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.494142 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.494310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.494542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.494542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.494879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.495044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.495203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.495203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.495488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.495643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.495798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.495962 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.496113 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.496262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.496417 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.496573 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.496722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.496895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.497053 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.497202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.497351 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.497525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.502134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.503484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.503661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.503817 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.503987 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.504142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.504302 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.504454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.504639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.504791 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.504948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.505104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.505263 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.505436 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.505598 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.506020 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.506178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.506330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.506478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.506642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.506800 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.506986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.507147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.507297 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.507447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.507621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.507780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.507936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.508085 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.508234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.508383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.508541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.508693 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.508852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.509148 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.509306 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.509992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.510155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.510350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.510514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.510665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.510892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.511060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.511210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.511366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.511523 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.511680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.511844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.512005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.512322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.512485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.512636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.512799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.512949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.513105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.513253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.513401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.513548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.513712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.513862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.513862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.514155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.514155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.514447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.514614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.514780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.514956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.515106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.515265 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.515424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.515580 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.515738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.516189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.516367 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.516519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.516677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.516837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.517541 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.517699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.517851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.517999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.518156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.518313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.518473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.518641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.518908 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.519073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.519223 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.519371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.519529 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.519679 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.519827 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.519977 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.520133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.520282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.520487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.520642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.520812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.520963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.521112 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.521271 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.521421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.521577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.521726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.521892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.522044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.522044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.522512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.522669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.522901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.523072 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.523231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.523469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.523622 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.523770 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.523770 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.524053 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.524217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.524375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.524524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.524680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.524829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.524993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.525763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.525927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.526453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.526612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.526612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.526942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.527104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.527264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.527423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.527579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.527738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.527895 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.528069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.528219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.528377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.528534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.528683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.528846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.528997 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.529146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.529295 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.529452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.529608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.529766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.529916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.530074 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.530224 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.530372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.530577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.530741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.531125 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.531277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.531426 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.531586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.531751 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.531916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.532077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.532227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.532387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.532661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.532828 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.532980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.533130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.533278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.533427 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.533826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.533995 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.534145 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.534301 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.534457 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.534631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.534783 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.534977 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.535130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.535279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.535428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.535583 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.535733 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.535891 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.536048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.536223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.536721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.536880 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.537050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.537208 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.537364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.537521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.537671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.537828 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.537987 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.538138 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.538294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.538451 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.538600 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.538749 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.538988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.538988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.539559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.539710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.539868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.540027 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.540184 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.540340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.540489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.540718 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.540840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.540966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541428 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541702 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.541982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542176 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542367 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542571 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542664 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.542969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543905 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.543993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.544699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.545868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.546519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.548614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.549840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.550437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.551181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.551181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.551181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.551181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.551501 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.551682 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.552011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.552337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.552650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.553050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.553309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.553659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.553983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.554327 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.554660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.555179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.555555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.555870 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:25:26.556122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:25:26.585769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO dbcounter [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Registered counter for database nova_api Sep 24 14:25:26.606306 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_db.sqlalchemy.engines [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.612871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writer thread running {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:26.618066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Registered counter for database nova_api Sep 24 14:25:26.639575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.646157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:26.668722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.context [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76c0b987-cac9-4795-a959-19f9a0a44deb(cell1) {{(pid=120744) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:25:26.672669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:25:26.673199 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:25:26.674754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:25:26.675508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:25:26.675957 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:25:26.677934 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:25:26.679931 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO dbcounter [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Registered counter for database nova_cell0 Sep 24 14:25:26.684421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO dbcounter [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Registered counter for database nova_cell1 Sep 24 14:25:26.691745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_db.sqlalchemy.engines [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.694353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_db.sqlalchemy.engines [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.698760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writer thread running {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:26.701747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.context [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76c0b987-cac9-4795-a959-19f9a0a44deb(cell1) {{(pid=120743) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:25:26.705801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:25:26.706277 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:25:26.707871 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:25:26.708612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:25:26.709062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:25:26.711088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:25:26.713117 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Registered counter for database nova_cell0 Sep 24 14:25:26.717096 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Registered counter for database nova_cell1 Sep 24 14:25:26.724363 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.725801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.732577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:26.733903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:26.837676 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writer thread running {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:26.847692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO dbcounter [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Registered counter for database nova_cell0 Sep 24 14:25:26.855892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_db.sqlalchemy.engines [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.860266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writer thread running {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:26.881303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Registered counter for database nova_cell0 Sep 24 14:25:26.888532 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:25:26.892954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:25:27.177626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: WARNING keystonemiddleware.auth_token [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:25:27.185520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: WARNING keystonemiddleware.auth_token [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:25:27.211713 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:25:27.219079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:25:27.529002 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: WARNING keystonemiddleware.auth_token [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:25:27.535725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: WARNING keystonemiddleware.auth_token [None req-8faed13e-ea2b-44fa-9aae-1147136c8401 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:25:27.542150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d4247179c0 pid: 120744 (default app) Sep 24 14:25:27.561789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:25:27.567781 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-ae1f6e40-4dfb-4270-a875-337c1a4c9336 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:25:27.573070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d4247179c0 pid: 120743 (default app) Sep 24 14:26:03.781455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:03.782573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:03.783678 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:03.784443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:04.115210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:04.116297 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:04.117812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:04.118581 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:05.157892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4ddad035-75c9-4cc4-8f7c-82c3a819cf7e tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Action: 'create', calling method: .version_select at 0x7f222ba54430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-358042627", "metadata": {"Type": "work"}}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4ddad035-75c9-4cc4-8f7c-82c3a819cf7e tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Request method failure captured: Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 121 Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxN7zF1rovrQr903Tj34Vdkb-GC0_3lm9nOosnMdp8eCP10nHBRVeFiWL6wsNGRCYQk3Dc5oGorEuT5cipxamCWYrNcFrfNByf-OPNtMMRlN0zRML5LgCQjtpBVX58tFCdokCdRkBBADHVDkS3ZM1T519TP0zZVbp_ZP9CVQXBqDulI Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:26:05.165262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d05d72126e6d4ec58cee3cc804a93fb6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d05d72126e6d4ec58cee3cc804a93fb6"}]}] Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 2038b90f689442489fb00fc6761d28c0 Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-358042627", "metadata": {"Type": "work"}}} Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:26:05.166602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-358042627', 'metadata': {'Type': 'work'}}}} Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise error Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi '#$%' Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:26:05.167542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 14:26:05.168904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 14:26:05.170165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 14:26:05.170165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.170165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4ddad035-75c9-4cc4-8f7c-82c3a819cf7e tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:26:05.170165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4ddad035-75c9-4cc4-8f7c-82c3a819cf7e tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.394560 Sep 24 14:26:05.172594 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 14:26:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:26:05.178388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e9cb7201-3d1b-4616-a938-3734130e7882 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Action: 'create', calling method: .version_select at 0x7f222ba54d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-756782991", "metadata": {"Type": "work"}}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e9cb7201-3d1b-4616-a938-3734130e7882 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Request method failure captured: Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 119 Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxN7zF1rovrQr903Tj34Vdkb-GC0_3lm9nOosnMdp8eCP10nHBRVeFiWL6wsNGRCYQk3Dc5oGorEuT5cipxamCWYrNcFrfNByf-OPNtMMRlN0zRML5LgCQjtpBVX58tFCdokCdRkBBADHVDkS3ZM1T519TP0zZVbp_ZP9CVQXBqDulI Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:26:05.182169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d05d72126e6d4ec58cee3cc804a93fb6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d05d72126e6d4ec58cee3cc804a93fb6"}]}] Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 2038b90f689442489fb00fc6761d28c0 Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-756782991", "metadata": {"Type": "work"}}} Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:26:05.184154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-756782991', 'metadata': {'Type': 'work'}}}} Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise error Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi '0' Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:26:05.184906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 14:26:05.186195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 14:26:05.187320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 14:26:05.187320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.187320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e9cb7201-3d1b-4616-a938-3734130e7882 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:26:05.187320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e9cb7201-3d1b-4616-a938-3734130e7882 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009598 Sep 24 14:26:05.202133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 14:26:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:26:05.215189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a1cd9440-aa21-4f93-8c9f-fafbf715dd30 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Action: 'create', calling method: .version_select at 0x7f222b90d160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1494435555", "metadata": {"Type": "work"}}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a1cd9440-aa21-4f93-8c9f-fafbf715dd30 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Request method failure captured: Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 119 Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxN7zF1rovrQr903Tj34Vdkb-GC0_3lm9nOosnMdp8eCP10nHBRVeFiWL6wsNGRCYQk3Dc5oGorEuT5cipxamCWYrNcFrfNByf-OPNtMMRlN0zRML5LgCQjtpBVX58tFCdokCdRkBBADHVDkS3ZM1T519TP0zZVbp_ZP9CVQXBqDulI Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:26:05.218887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d05d72126e6d4ec58cee3cc804a93fb6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d05d72126e6d4ec58cee3cc804a93fb6"}]}] Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 2038b90f689442489fb00fc6761d28c0 Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1494435555", "metadata": {"Type": "work"}}} Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:26:05.220150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1494435555', 'metadata': {'Type': 'work'}}}} Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise error Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi '' Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:26:05.220927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 14:26:05.222231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 14:26:05.223481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 14:26:05.223481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:05.223481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a1cd9440-aa21-4f93-8c9f-fafbf715dd30 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:26:05.223481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a1cd9440-aa21-4f93-8c9f-fafbf715dd30 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009004 Sep 24 14:26:05.223481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 14:26:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:26:05.243066 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a229d9dc-7ef3-4017-b3ca-ac1cc4843a09 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Calling method '.version_select at 0x7f222b90db80>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:05.549114 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0211905b-2cc1-4d0e-9b27-9ee0ee7479f9 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Action: 'create', calling method: .version_select at 0x7f222ba53430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2086413105", "metadata": {"Type": "work"}}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:06.516789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-a229d9dc-7ef3-4017-b3ca-ac1cc4843a09 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] HTTP exception thrown: Volume tempest-invalid-1852172990 could not be found. Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a229d9dc-7ef3-4017-b3ca-ac1cc4843a09 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Request method failure captured: Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1852172990 HTTP/1.1 Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxN7zF1rovrQr903Tj34Vdkb-GC0_3lm9nOosnMdp8eCP10nHBRVeFiWL6wsNGRCYQk3Dc5oGorEuT5cipxamCWYrNcFrfNByf-OPNtMMRlN0zRML5LgCQjtpBVX58tFCdokCdRkBBADHVDkS3ZM1T519TP0zZVbp_ZP9CVQXBqDulI Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:26:06.521288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d05d72126e6d4ec58cee3cc804a93fb6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d05d72126e6d4ec58cee3cc804a93fb6"}]}] Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 2038b90f689442489fb00fc6761d28c0 Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Volume tempest-invalid-1852172990 could not be found. Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'tempest-invalid-1852172990'} Sep 24 14:26:06.522668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1852172990 could not be found. (HTTP 404) (Request-ID: req-e054dc0c-ce17-4227-8e83-7f0b7fe332be) Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:06.523735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 14:26:06.524973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1852172990 could not be found. Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:26:06.526237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1852172990 could not be found. Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1852172990 could not be found. Sep 24 14:26:06.530180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.533268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a229d9dc-7ef3-4017-b3ca-ac1cc4843a09 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Returning 404 to user: Volume tempest-invalid-1852172990 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:26:06.535228 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a229d9dc-7ef3-4017-b3ca-ac1cc4843a09 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1852172990" status: 404 len: 99 microversion: 2.1 time: 1.296758 Sep 24 14:26:06.542685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 14:26:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1852172990 => generated 99 bytes in 1299 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 14:26:06.558686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5908aeb7-0e91-48c4-a9f9-3b04b4651b1d tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008693 Sep 24 14:26:06.563831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1140 bytes} [Sat Sep 24 14:26:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 14:26:06.596197 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2cb35742-5878-48ed-8e5a-35d02bfcc7c3 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017014 Sep 24 14:26:06.600642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1137 bytes} [Sat Sep 24 14:26:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 14:26:06.623074 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-980c46ab-679a-4f08-8078-6d2337c27ee9 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Calling method '.version_select at 0x7f222b842310>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:06.943272 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-980c46ab-679a-4f08-8078-6d2337c27ee9 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] HTTP exception thrown: Volume 9fb35919-0978-4ca9-8f8b-72d4e00ba325 could not be found. Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-980c46ab-679a-4f08-8078-6d2337c27ee9 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Request method failure captured: Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/os-volumes/9fb35919-0978-4ca9-8f8b-72d4e00ba325 HTTP/1.1 Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxN7zF1rovrQr903Tj34Vdkb-GC0_3lm9nOosnMdp8eCP10nHBRVeFiWL6wsNGRCYQk3Dc5oGorEuT5cipxamCWYrNcFrfNByf-OPNtMMRlN0zRML5LgCQjtpBVX58tFCdokCdRkBBADHVDkS3ZM1T519TP0zZVbp_ZP9CVQXBqDulI Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:26:06.945392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d05d72126e6d4ec58cee3cc804a93fb6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d05d72126e6d4ec58cee3cc804a93fb6"}]}] Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 2038b90f689442489fb00fc6761d28c0 Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Volume 9fb35919-0978-4ca9-8f8b-72d4e00ba325 could not be found. Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '9fb35919-0978-4ca9-8f8b-72d4e00ba325'} Sep 24 14:26:06.946994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9fb35919-0978-4ca9-8f8b-72d4e00ba325 could not be found. (HTTP 404) (Request-ID: req-da0c9176-781b-4bea-9bc9-be601610eafb) Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:06.947941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 14:26:06.949258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9fb35919-0978-4ca9-8f8b-72d4e00ba325 could not be found. Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 14:26:06.950330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9fb35919-0978-4ca9-8f8b-72d4e00ba325 could not be found. Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9fb35919-0978-4ca9-8f8b-72d4e00ba325 could not be found. Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-980c46ab-679a-4f08-8078-6d2337c27ee9 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Returning 404 to user: Volume 9fb35919-0978-4ca9-8f8b-72d4e00ba325 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-980c46ab-679a-4f08-8078-6d2337c27ee9 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/9fb35919-0978-4ca9-8f8b-72d4e00ba325" status: 404 len: 109 microversion: 2.1 time: 0.341682 Sep 24 14:26:06.951501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:26:06 2022] DELETE /compute/v2.1/os-volumes/9fb35919-0978-4ca9-8f8b-72d4e00ba325 => generated 109 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:26:06.957220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7b266e02-0e98-4143-a9dc-d17efb32d310 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Calling method '.version_select at 0x7f222b842280>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:07.774262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-7b266e02-0e98-4143-a9dc-d17efb32d310 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] HTTP exception thrown: Volume 53f01d1d-9c7d-48cd-bc41-78fe87a61caa could not be found. Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7b266e02-0e98-4143-a9dc-d17efb32d310 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Request method failure captured: Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/os-volumes/53f01d1d-9c7d-48cd-bc41-78fe87a61caa HTTP/1.1 Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxN7zF1rovrQr903Tj34Vdkb-GC0_3lm9nOosnMdp8eCP10nHBRVeFiWL6wsNGRCYQk3Dc5oGorEuT5cipxamCWYrNcFrfNByf-OPNtMMRlN0zRML5LgCQjtpBVX58tFCdokCdRkBBADHVDkS3ZM1T519TP0zZVbp_ZP9CVQXBqDulI Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:26:07.776989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d05d72126e6d4ec58cee3cc804a93fb6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d05d72126e6d4ec58cee3cc804a93fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d05d72126e6d4ec58cee3cc804a93fb6"}]}] Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: d05d72126e6d4ec58cee3cc804a93fb6 Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesNegativeTest-1361282261 Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 2038b90f689442489fb00fc6761d28c0 Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesNegativeTest-1361282261-project Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Volume 53f01d1d-9c7d-48cd-bc41-78fe87a61caa could not be found. Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '53f01d1d-9c7d-48cd-bc41-78fe87a61caa'} Sep 24 14:26:07.778092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53f01d1d-9c7d-48cd-bc41-78fe87a61caa could not be found. (HTTP 404) (Request-ID: req-ee295239-90fa-4b41-9a2e-21837c2b4db2) Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:07.778750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:26:07.779739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53f01d1d-9c7d-48cd-bc41-78fe87a61caa could not be found. Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 14:26:07.780680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53f01d1d-9c7d-48cd-bc41-78fe87a61caa could not be found. Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53f01d1d-9c7d-48cd-bc41-78fe87a61caa could not be found. Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7b266e02-0e98-4143-a9dc-d17efb32d310 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] Returning 404 to user: Volume 53f01d1d-9c7d-48cd-bc41-78fe87a61caa could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7b266e02-0e98-4143-a9dc-d17efb32d310 tempest-VolumesNegativeTest-1361282261 tempest-VolumesNegativeTest-1361282261-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/53f01d1d-9c7d-48cd-bc41-78fe87a61caa" status: 404 len: 109 microversion: 2.1 time: 0.825206 Sep 24 14:26:07.781686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 8/8] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:26:06 2022] GET /compute/v2.1/os-volumes/53f01d1d-9c7d-48cd-bc41-78fe87a61caa => generated 109 bytes in 827 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 14:26:07.920596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0211905b-2cc1-4d0e-9b27-9ee0ee7479f9 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.812813 Sep 24 14:26:07.921550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 1/9] 10.222.0.52 () {60 vars in 1156 bytes} [Sat Sep 24 14:26:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3816 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 14:26:07.937400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-259c5374-dc5e-4a9d-88c4-7c1e8448d88b tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Calling method '.version_select at 0x7f222b90ddc0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:08.107292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-259c5374-dc5e-4a9d-88c4-7c1e8448d88b tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0" status: 200 len: 353 microversion: 2.1 time: 0.173839 Sep 24 14:26:08.108360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 9/10] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:26:07 2022] GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0 => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:26:09.134656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5589d38f-3a99-4532-9942-22ed429baeb2 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Calling method '.version_select at 0x7f222b928310>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:09.495475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5589d38f-3a99-4532-9942-22ed429baeb2 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0" status: 200 len: 354 microversion: 2.1 time: 0.373245 Sep 24 14:26:09.496228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 2/11] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:26:09 2022] GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0 => generated 354 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:26:09.511358 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-86eb8050-1146-414a-b162-60b31fb5c10b tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Calling method '.version_select at 0x7f222b842940>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:09.734181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-86eb8050-1146-414a-b162-60b31fb5c10b tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0" status: 200 len: 354 microversion: 2.1 time: 0.228346 Sep 24 14:26:09.734977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 10/12] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:26:09 2022] GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0 => generated 354 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:26:09.762911 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-21d1a4d2-772c-44ba-8c04-f0aab39dbe45 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Calling method '.version_select at 0x7f222b9289d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:09.946981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-21d1a4d2-772c-44ba-8c04-f0aab39dbe45 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0" status: 202 len: 0 microversion: 2.1 time: 0.190448 Sep 24 14:26:09.948011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 3/13] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:26:09 2022] DELETE /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:26:09.956073 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-eb7eda6f-0a39-4764-9d4d-bc56720e7670 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Calling method '.version_select at 0x7f222b842160>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:10.095203 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-eb7eda6f-0a39-4764-9d4d-bc56720e7670 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0" status: 200 len: 353 microversion: 2.1 time: 0.143279 Sep 24 14:26:10.095760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 11/14] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:26:09 2022] GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:26:11.123378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f7a648c7-642e-4374-aa0a-01d658040f12 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Calling method '.version_select at 0x7f222b8c10d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:11.182967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-f7a648c7-642e-4374-aa0a-01d658040f12 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] HTTP exception thrown: Volume a7ec1f37-e161-487e-893e-7d6efaa9e0a0 could not be found. Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f7a648c7-642e-4374-aa0a-01d658040f12 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Request method failure captured: Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0 HTTP/1.1 Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxN8hrn5zBpkx-xrzltHpNmm4Sc1xiamzneK52OkWASpoRDRDwZYORg9IuUp_zpXVPJxiBsl7pxkEvVISuM28506Wx2a7PGgdrJcgvlhNxVmbti4VNzBgcOIX77MkVfj5-la20_Wv0ECBQBJbnelLlM5vyMJQAyN_v8sjg1WGUm6BkE Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: c8d85d19f92d43d38b05bf9a5a73f550 Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesGetTestJSON-1342297840 Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:26:11.194778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8d85d19f92d43d38b05bf9a5a73f550"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8d85d19f92d43d38b05bf9a5a73f550", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8d85d19f92d43d38b05bf9a5a73f550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8d85d19f92d43d38b05bf9a5a73f550"}]}] Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesGetTestJSON-1342297840 Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: c8d85d19f92d43d38b05bf9a5a73f550 Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesGetTestJSON-1342297840 Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesGetTestJSON-1342297840-project Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: 2d15654b29bd450f9af8e39b9119e3fa Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesGetTestJSON-1342297840-project Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Volume a7ec1f37-e161-487e-893e-7d6efaa9e0a0 could not be found. Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'a7ec1f37-e161-487e-893e-7d6efaa9e0a0'} Sep 24 14:26:11.196486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7ec1f37-e161-487e-893e-7d6efaa9e0a0 could not be found. (HTTP 404) (Request-ID: req-38430d77-53fd-4194-b669-9e34d5b76ff8) Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:11.197105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:26:11.198035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7ec1f37-e161-487e-893e-7d6efaa9e0a0 could not be found. Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 14:26:11.199133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7ec1f37-e161-487e-893e-7d6efaa9e0a0 could not be found. Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7ec1f37-e161-487e-893e-7d6efaa9e0a0 could not be found. Sep 24 14:26:11.199984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:26:11.205010 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f7a648c7-642e-4374-aa0a-01d658040f12 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] Returning 404 to user: Volume a7ec1f37-e161-487e-893e-7d6efaa9e0a0 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:26:11.205974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f7a648c7-642e-4374-aa0a-01d658040f12 tempest-VolumesGetTestJSON-1342297840 tempest-VolumesGetTestJSON-1342297840-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0" status: 404 len: 109 microversion: 2.1 time: 0.100008 Sep 24 14:26:11.206987 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 4/15] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:26:11 2022] GET /compute/v2.1/os-volumes/a7ec1f37-e161-487e-893e-7d6efaa9e0a0 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:26:14.762867 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1164516199", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "networks": [{"uuid": "e2d3fb2a-c442-43ad-bf5f-ade60c86b674"}]}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:15.129289 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] validate_networks() for [('e2d3fb2a-c442-43ad-bf5f-ade60c86b674', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:26:17.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:26:17.234133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:26:17.234654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:26:17.235090 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:26:17.235651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:26:17.302506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:17.306532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:17.307337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:17.308984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:17.310548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:17.312881 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:17.389880 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Getting quotas for project 6bb2f863f5834cd4a47a3ed9feda7c02. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:26:17.405117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Getting quotas for user 75575c10a8eb4ebfab5b2f0c330541df and project 6bb2f863f5834cd4a47a3ed9feda7c02. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:26:17.431155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:26:17.433972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:26:17.699737 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7d9ff0c8-db74-4817-93ec-2d761348d7ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.263317 Sep 24 14:26:17.702804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 12/16] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:26:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:26:17.715999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c14a0e56-bfb6-465f-a6d9-37f39c739c77 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:17.716744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c14a0e56-bfb6-465f-a6d9-37f39c739c77 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:18.031394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c14a0e56-bfb6-465f-a6d9-37f39c739c77 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:18.060981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c14a0e56-bfb6-465f-a6d9-37f39c739c77 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1215 microversion: 2.1 time: 0.348969 Sep 24 14:26:18.083553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 5/17] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:17 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1215 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:19.100702 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ab5ba2de-5e38-4b71-9691-4e9de7ba171e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:19.102609 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ab5ba2de-5e38-4b71-9691-4e9de7ba171e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:19.391101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ab5ba2de-5e38-4b71-9691-4e9de7ba171e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:19.418235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ab5ba2de-5e38-4b71-9691-4e9de7ba171e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1215 microversion: 2.1 time: 0.321782 Sep 24 14:26:19.421148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 13/18] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:19 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:20.297742 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-493926394", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:20.449832 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:20.450579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:20.481782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:20.482289 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:20.482735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:20.487016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:20.487512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:20.487956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:20.507863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] validate_networks() for [('24a47d24-f7df-4dec-9596-133c854781ec', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:26:20.714796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:20.745892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-04aa757d-5563-40c4-86d1-1660ee99390a tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1219 microversion: 2.1 time: 0.298515 Sep 24 14:26:20.748878 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 14/19] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:20 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:21.778138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:21.781577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:21.792671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:21.793499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:21.794121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:21.795045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:21.795709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:21.796505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:22.055087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:22.079676 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1bf576f5-fd03-4176-9791-6c2086667228 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1267 microversion: 2.1 time: 0.310471 Sep 24 14:26:22.097647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 15/20] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:21 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:22.717692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:26:22.718767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:26:22.727831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:26:22.728679 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:26:22.729311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:26:22.763686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:22.764334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:22.764900 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:22.765750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:22.766346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:22.766925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:22.817085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for project 9b458789f89a441caad76e78167bc00b. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:26:22.832754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for user c3cf8e31062d4bd7bfa76c09e7e2adea and project 9b458789f89a441caad76e78167bc00b. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:26:22.857691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:26:22.859474 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b4644e6e-bf84-4929-b417-cd868d6a0b36 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'create', calling method: .version_select at 0x7f222aeaeb80>, body: {"keypair": {"name": "tempest-keypair-2063684187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeAMigvqTpsDRNFmB+//vVfmw4iL/tbnoFiE4y0G8ovTV0D2HhAE+yTLElH0lsd8lfDkBhIxnEeq5Lby0YOtHRKr/iiq8CDq/3GV6Jj2A3oSWbQ7WimEuUJez+g3n2ggg=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:22.865665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:26:22.950988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-b4644e6e-bf84-4929-b417-cd868d6a0b36 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for project 1f7134ad65014cb984417c99b3d76eff. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:26:22.965014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-b4644e6e-bf84-4929-b417-cd868d6a0b36 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for user 883e6570afb84a099e46cdace5a88b2e and project 1f7134ad65014cb984417c99b3d76eff. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:26:23.004389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fe5c1f0d-676a-4265-937b-30147a40b5e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.007284 Sep 24 14:26:23.005105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 6/21] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:26:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:26:23.021392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c8cbfccb-d4c4-4243-b014-bff3543a83c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:23.032321 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c8cbfccb-d4c4-4243-b014-bff3543a83c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:23.116342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b4644e6e-bf84-4929-b417-cd868d6a0b36 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.387447 Sep 24 14:26:23.119030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 16/22] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 14:26:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 391 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 14:26:23.129095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:23.129748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:23.133033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c8cbfccb-d4c4-4243-b014-bff3543a83c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:23.142714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c8cbfccb-d4c4-4243-b014-bff3543a83c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1221 microversion: 2.1 time: 0.127785 Sep 24 14:26:23.175255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 7/23] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:23 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1221 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:23.197462 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:23.200081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:23.201340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:23.209362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:23.211578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:23.212315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:23.276707 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1802629020", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:23.448320 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] validate_networks() for [('24a47d24-f7df-4dec-9596-133c854781ec', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:26:23.515921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:23.531707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d422a995-03f2-4ac0-ae9f-dfba3b664014 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1273 microversion: 2.1 time: 0.407055 Sep 24 14:26:23.532350 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 17/24] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:23 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1273 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:24.559021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:24.559688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:24.568004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:24.572093 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:24.572784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:24.575711 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:24.577984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:24.578692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:24.879884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:24.895386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-02cc126e-56a0-4b61-a6ab-81f69d432028 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1273 microversion: 2.1 time: 0.341141 Sep 24 14:26:24.896312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 18/25] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:24 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:25.259562 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:26:25.260624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:26:25.261246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:26:25.261826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:26:25.262530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:26:25.295201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:25.301418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:25.305112 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:25.307467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:25.309211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:25.315497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:25.394689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for project 9b458789f89a441caad76e78167bc00b. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:26:25.409152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for user c3cf8e31062d4bd7bfa76c09e7e2adea and project 9b458789f89a441caad76e78167bc00b. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:26:25.446410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:26:25.451458 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:26:25.562290 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da459f2b-02e3-4d86-b917-99f7a7734222 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.289717 Sep 24 14:26:25.566909 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 8/26] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:26:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:26:25.575103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4e0dec3d-fe2e-419c-b4d9-ce5f8afbd32d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:25.575734 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4e0dec3d-fe2e-419c-b4d9-ce5f8afbd32d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:25.906832 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4e0dec3d-fe2e-419c-b4d9-ce5f8afbd32d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:25.919691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4e0dec3d-fe2e-419c-b4d9-ce5f8afbd32d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1222 microversion: 2.1 time: 0.347953 Sep 24 14:26:25.920762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 19/27] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:25 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1222 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:25.947541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:25.959990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:26.000687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:26.001182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:26.001617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:26.002329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:26.002808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:26.009103 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:26.446771 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:26.503997 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-aa40d835-e6fd-4e43-a5d9-909910fcf599 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1273 microversion: 2.1 time: 0.586189 Sep 24 14:26:26.507004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 9/28] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:25 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1273 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:26.949846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:26.951179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:26.958032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:26.972048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:26.972766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:26.973712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:26.974337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:26.974949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:27.351513 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:27.431888 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:27.441300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-648df760-df2e-43e1-8800-da65ee238e40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1226 microversion: 2.1 time: 0.495300 Sep 24 14:26:27.445846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 20/29] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:26 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1226 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:27.537183 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:27.538643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:27.553402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:27.554351 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:27.560906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:27.563787 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:27.564287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:27.564727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:27.707551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:27.720489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-54abd144-2072-4829-a006-1d8b767a4a7d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1273 microversion: 2.1 time: 0.190297 Sep 24 14:26:27.738019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 10/30] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:27 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:28.484643 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:28.487955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:28.523277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:28.525421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:28.528689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:28.529914 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:28.530591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:28.531759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:28.747944 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:28.749260 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:28.757587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:28.758787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:28.761552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:28.763896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:28.767156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:28.768300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:28.769247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:28.779803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-86287550-4171-4853-991b-109a7eee0910 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1218 microversion: 2.1 time: 0.303050 Sep 24 14:26:28.803004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 21/31] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:28 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1218 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:28.844260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1838107261", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "841ec28f-242a-4287-8d65-ef9f3927d5d5"}], "security_groups": [{"name": "tempest-securitygroup--1822466916"}], "key_name": "tempest-keypair-2063684187", "user_data": "}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:29.082296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:29.090628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e51f81ec-3256-4f70-b97d-b95cb0544a55 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1273 microversion: 2.1 time: 0.346222 Sep 24 14:26:29.106843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 11/32] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:28 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:29.634240 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] validate_networks() for [('841ec28f-242a-4287-8d65-ef9f3927d5d5', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:26:29.809488 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:29.810111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:29.823745 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:29.824665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:29.825287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:29.826002 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:29.826463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:29.826993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:30.134854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:30.148675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b994c3da-e8b4-400b-afe5-fd309ce02fd2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1274 microversion: 2.1 time: 0.345134 Sep 24 14:26:30.167564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 12/33] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:29 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1274 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:30.184837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:30.186706 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:30.205714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:30.206248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:30.209148 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:30.210001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:30.212269 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:30.212783 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:31.090286 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:31.119028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-514e91a3-b8df-4b48-860f-3808ddcee623 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.949042 Sep 24 14:26:31.137340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 13/34] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:30 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:31.173509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:31.175630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:31.190406 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:31.191247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:31.192537 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:31.193475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:31.195619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:31.198502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:31.568266 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:31.584374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-866b271f-4b5e-48c4-9da3-74fbacd01478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1280 microversion: 2.1 time: 0.411223 Sep 24 14:26:31.586230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 14/35] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:31 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:31.705276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:26:31.706595 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:26:31.707321 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:26:31.707883 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:26:31.708445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:26:31.757217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:31.757833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:31.759135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:31.761688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:31.768155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:31.770056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:31.839729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for project 1f7134ad65014cb984417c99b3d76eff. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:26:31.858337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for user 883e6570afb84a099e46cdace5a88b2e and project 1f7134ad65014cb984417c99b3d76eff. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:26:31.909453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:26:31.913723 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:26:32.077571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cd308d25-90d2-48d1-8fec-f37368e733a8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.250732 Sep 24 14:26:32.079331 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 22/36] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 14:26:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 3254 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 14:26:32.091264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f0711a43-4b80-4ed1-8483-de88c7f69e2f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:32.091992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f0711a43-4b80-4ed1-8483-de88c7f69e2f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:32.151603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:32.151786 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:32.165795 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:32.166483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:32.167416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:32.170963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:32.171633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:32.172226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:32.418640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f0711a43-4b80-4ed1-8483-de88c7f69e2f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:32.439024 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f0711a43-4b80-4ed1-8483-de88c7f69e2f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:32.459762 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f0711a43-4b80-4ed1-8483-de88c7f69e2f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:32.467467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f0711a43-4b80-4ed1-8483-de88c7f69e2f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1282 microversion: 2.20 time: 0.378748 Sep 24 14:26:32.470801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 15/37] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:32 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1282 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:32.614629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:32.615270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:32.636313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:32.636313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:32.636313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:32.641087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:32.642607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:32.644235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:32.887225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:32.896654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1a5550b0-c30b-4745-8b98-249fe89167a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1280 microversion: 2.1 time: 0.286673 Sep 24 14:26:32.903737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 16/38] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:32 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:33.354092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:33.364042 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cb7733e2-1dd4-42c6-b4e4-08158ec066f3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 1.218284 Sep 24 14:26:33.373285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 23/39] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:32 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:33.501435 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f9fe6526-2d9a-42ad-89bf-de7c31fdae6d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:33.502209 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f9fe6526-2d9a-42ad-89bf-de7c31fdae6d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:33.722350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f9fe6526-2d9a-42ad-89bf-de7c31fdae6d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:33.751348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f9fe6526-2d9a-42ad-89bf-de7c31fdae6d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:33.773323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f9fe6526-2d9a-42ad-89bf-de7c31fdae6d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:33.777718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f9fe6526-2d9a-42ad-89bf-de7c31fdae6d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1282 microversion: 2.20 time: 0.280345 Sep 24 14:26:33.779747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 17/40] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:33 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1282 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:33.936937 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:33.938870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:33.962689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:33.965995 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:33.968819 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:33.974520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:33.976360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:33.978741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:34.355323 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:34.371370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-79384d33-1f7d-4a7c-84c9-ae8df5d3a053 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1280 microversion: 2.1 time: 0.445923 Sep 24 14:26:34.406692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:34.407467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:34.438475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:34.442090 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:34.442734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:34.443667 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:34.448115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:34.448776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:34.458312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 24/41] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:33 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1280 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:34.796772 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-8d8b003e-daeb-410c-a4bd-32ffd7b99e87 req-09137b8e-2a24-408e-9f41-5fd26e50738c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917f5416-f73d-496e-b89a-b62e69db68d8", "tag": "9ed51186-1d2e-4988-a33e-ce4caba1e8cf"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:34.827649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8d8b003e-daeb-410c-a4bd-32ffd7b99e87 req-09137b8e-2a24-408e-9f41-5fd26e50738c service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:34.828385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8d8b003e-daeb-410c-a4bd-32ffd7b99e87 req-09137b8e-2a24-408e-9f41-5fd26e50738c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:34.839527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8d8b003e-daeb-410c-a4bd-32ffd7b99e87 req-09137b8e-2a24-408e-9f41-5fd26e50738c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:34.891017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-8d8b003e-daeb-410c-a4bd-32ffd7b99e87 req-09137b8e-2a24-408e-9f41-5fd26e50738c service nova] Creating event network-changed:9ed51186-1d2e-4988-a33e-ce4caba1e8cf for instance 917f5416-f73d-496e-b89a-b62e69db68d8 on hv-cinder-85919 Sep 24 14:26:34.892733 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8d8b003e-daeb-410c-a4bd-32ffd7b99e87 req-09137b8e-2a24-408e-9f41-5fd26e50738c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 14:26:34.894569 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8d8b003e-daeb-410c-a4bd-32ffd7b99e87 req-09137b8e-2a24-408e-9f41-5fd26e50738c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 14:26:34.895837 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:34.898797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:34.901377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:34.902353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:34.903101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:34.906276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:34.947073 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.compute.rpcapi [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 14:26:34.947990 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] Releasing lock "compute-rpcapi-router" {{(pid=120744) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 14:26:35.005169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6bc3f542-3b4e-444e-9d3d-2baf32a0a590 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.519168 Sep 24 14:26:35.021186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 25/42] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:26:35.044480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:35.045223 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:35.063951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:35.078550 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:35.079080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:35.087355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:35.087823 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:35.089127 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:35.217063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:35.228440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:35.230808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:35.232268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8a44b657-5a30-4e90-a37a-e282497a45c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1334 microversion: 2.20 time: 0.208641 Sep 24 14:26:35.246927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 26/43] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:35 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1334 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:35.363239 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:35.400410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:35.401129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:35.411604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:35.412188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:35.415816 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:35.416756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:35.417450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:35.418648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:35.425635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3d7faead-7a6b-45f5-a4a6-fe6401197336 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 1.030174 Sep 24 14:26:35.435010 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 18/44] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:34 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:35.457495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:35.942605 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:35.954857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7ae73c34-735e-458a-abd4-bf4ca95ecbff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.557945 Sep 24 14:26:35.957449 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 27/45] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:35 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:36.260483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:36.261785 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:36.273495 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:36.274253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:36.274969 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:36.276163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:36.277129 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:36.278307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:36.383621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:36.398227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:36.400967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:36.403124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4ae3a0c4-4768-4b22-8aac-c18cc2b43301 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1334 microversion: 2.20 time: 0.148461 Sep 24 14:26:36.405411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 19/46] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:36 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1334 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:36.453502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:36.454225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:36.472961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:36.474200 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:36.474943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:36.476918 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:36.495347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:36.498538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:36.980932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:36.981875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:36.989627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:36.992915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:36.993613 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:37.001851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:37.003511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:37.004413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:37.420877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:37.434042 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-40c6e772-f33c-4e47-bd4d-30fa4bb5577b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.987579 Sep 24 14:26:37.452080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 28/47] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:36 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:37.494421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:37.498442 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:37.514362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:37.515233 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:37.515930 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:37.530694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:37.531759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:37.532413 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:37.791290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:37.821979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:37.836871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:37.838028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-95407db3-08a7-464d-a3e8-895ffae8aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1340 microversion: 2.20 time: 0.372736 Sep 24 14:26:37.838751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 29/48] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:37 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1340 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:38.049464 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:38.057489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1533c0a4-2619-463f-b9d3-c7f98b3ec741 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 1.080664 Sep 24 14:26:38.058240 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 20/49] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:36 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:38.464651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:38.465637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:38.478729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:38.479597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:38.480810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:38.486899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:38.487875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:38.488552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:38.868275 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:38.869120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:38.887702 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:38.891347 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:38.891973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:38.892862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:38.893473 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:38.895231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:38.957334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:38.971222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fae616ed-31b0-4ccb-b705-32ffdd474683 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.511153 Sep 24 14:26:38.976869 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 30/50] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:38 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:39.086974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:39.087603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:39.099008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:39.099699 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:39.100823 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:39.101639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:39.104865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:39.115028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:39.164152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:39.181312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:39.182906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:39.184036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-00c7e20a-f8c9-4419-97d7-74161749d54b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1340 microversion: 2.20 time: 0.320728 Sep 24 14:26:39.184595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 21/51] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:38 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1340 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:39.557856 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:39.571333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-87456863-fe58-4114-a0f9-989e844be923 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.495062 Sep 24 14:26:39.579352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 31/52] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:39 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:40.004687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:40.009066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:40.021155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.022011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.023144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.025613 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.026881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.027786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.228225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:40.229307 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:40.243070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.245034 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.271352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.272948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.273725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.275304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.533771 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:40.552071 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b21b5183-4888-46e4-b367-abe9681bd7ed tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.553976 Sep 24 14:26:40.552955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 22/53] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:39 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:40.694272 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:40.702714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:40.704467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:40.705564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8cbb7d0d-92f7-41d8-96fa-b8721cc9f2a6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.498543 Sep 24 14:26:40.706269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 32/54] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:40 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:40.710891 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:40.711731 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:40.728248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-0cbb76ea-71dc-46eb-9a22-f05ecf1a521e req-20e50acf-189a-4e85-9c18-d16c1ead730f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f95b7f-2918-442c-ba7f-832ba9156e7d", "tag": "3c943efd-ace2-4916-8133-bc99ff2e01cf"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:40.737924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.739634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.740304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.742579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.743869 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.744465 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.755634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:40.757432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0cbb76ea-71dc-46eb-9a22-f05ecf1a521e req-20e50acf-189a-4e85-9c18-d16c1ead730f service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.758206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0cbb76ea-71dc-46eb-9a22-f05ecf1a521e req-20e50acf-189a-4e85-9c18-d16c1ead730f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.758599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0cbb76ea-71dc-46eb-9a22-f05ecf1a521e req-20e50acf-189a-4e85-9c18-d16c1ead730f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.789601 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-0cbb76ea-71dc-46eb-9a22-f05ecf1a521e req-20e50acf-189a-4e85-9c18-d16c1ead730f service nova] Creating event network-changed:3c943efd-ace2-4916-8133-bc99ff2e01cf for instance c7f95b7f-2918-442c-ba7f-832ba9156e7d on hv-cinder-85919 Sep 24 14:26:40.792155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0cbb76ea-71dc-46eb-9a22-f05ecf1a521e req-20e50acf-189a-4e85-9c18-d16c1ead730f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 14:26:40.795163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0cbb76ea-71dc-46eb-9a22-f05ecf1a521e req-20e50acf-189a-4e85-9c18-d16c1ead730f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 14:26:40.796215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.796683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.797107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.797809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:40.807284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:40.807777 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:40.840874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.compute.rpcapi [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 14:26:40.843211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 14:26:40.877156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-159490f1-a4d9-431d-a4e1-feb10c727dc8 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322516 Sep 24 14:26:40.878791 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 23/55] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:26:41.009830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:41.018188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7fcfe640-ee92-43d1-ad32-b916bf84ee8a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.310412 Sep 24 14:26:41.034658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 33/56] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:40 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:41.579115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:41.580479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:41.588696 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:41.589671 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:41.590261 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:41.595070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:41.595070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:41.595070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:41.733453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:41.734769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:41.742777 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:41.746802 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:41.747285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:41.748006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:41.748467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:41.748897 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:41.772813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:41.782512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cd59caa9-869e-457e-a354-9bb3f8b5e5cf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.211197 Sep 24 14:26:41.783621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 24/57] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:41 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:41.891583 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=20 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:41.903691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:41.915114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:41.916770 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:41.919019 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-13d25d0d-9459-49ab-8a11-a3456561db47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.189930 Sep 24 14:26:41.930892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 34/58] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:41 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:42.041981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:42.042789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:42.050127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:42.050614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:42.051326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:42.052198 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:42.052654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:42.053078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:42.197108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:42.205265 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e806b377-8f47-468b-970f-1d857fc19e42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.167575 Sep 24 14:26:42.205832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 25/59] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:42 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:42.807850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:42.808479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:42.815322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:42.815908 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:42.816338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:42.817239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:42.817851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:42.818272 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:42.923278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-2038c8d8-1a8b-4ab1-a135-b07a84eb44e0 req-61b6e7fa-bd8b-444a-8719-eaad55316454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3aab52-9469-4a21-98ba-f83382ebf7ab", "tag": "812bad02-1d00-421a-acb7-00e2e9023540"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:42.939289 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-2038c8d8-1a8b-4ab1-a135-b07a84eb44e0 req-61b6e7fa-bd8b-444a-8719-eaad55316454 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:42.940541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-2038c8d8-1a8b-4ab1-a135-b07a84eb44e0 req-61b6e7fa-bd8b-444a-8719-eaad55316454 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:42.941698 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-2038c8d8-1a8b-4ab1-a135-b07a84eb44e0 req-61b6e7fa-bd8b-444a-8719-eaad55316454 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:42.970019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-2038c8d8-1a8b-4ab1-a135-b07a84eb44e0 req-61b6e7fa-bd8b-444a-8719-eaad55316454 service nova] Creating event network-changed:812bad02-1d00-421a-acb7-00e2e9023540 for instance db3aab52-9469-4a21-98ba-f83382ebf7ab on hv-cinder-85919 Sep 24 14:26:42.980113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-2038c8d8-1a8b-4ab1-a135-b07a84eb44e0 req-61b6e7fa-bd8b-444a-8719-eaad55316454 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069603 Sep 24 14:26:42.981552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 26/60] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:26:42.991774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:42.993148 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:43.003334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:43.004164 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:43.004887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:43.005106 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:43.006929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:43.008378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:43.009113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:43.015677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3b9339f3-ca1d-440a-8424-3ea702cd2d6e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.211809 Sep 24 14:26:43.019380 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 35/61] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:42 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:43.204607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:43.209361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:43.215099 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:43.216849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:43.218120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a926172d-b635-4bc4-8493-566ed9c7aa43 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.234331 Sep 24 14:26:43.218848 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 27/62] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:42 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:43.238500 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:43.239903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:43.246681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:43.247247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:43.247740 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:43.250607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:43.251096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:43.251638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:43.416670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:43.426227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-93f5d47f-b858-429b-8af3-d191a4c29bbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.192195 Sep 24 14:26:43.426969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 36/63] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:43 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:44.041854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:44.042479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:44.044287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=20 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:44.055670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:44.056164 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:44.056601 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:44.057297 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:44.057752 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:44.058172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:44.225368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:44.233380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fa4bb689-64ed-4781-8250-6fac026a8af0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.195737 Sep 24 14:26:44.234062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 28/64] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:44 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:44.243753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:44.244484 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:44.250260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:44.250804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:44.251264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:44.251994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:44.252437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:44.252848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:44.384282 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:44.392600 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:44.394123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:44.395347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d002e3c9-69fd-4a28-97dd-f0dc466d9ff2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.155939 Sep 24 14:26:44.395983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 37/65] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:44 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:44.450612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:44.451255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:44.457456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:44.457942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:44.458377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:44.459092 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:44.459568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:44.460063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:44.642741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:44.651192 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ba3bf2c7-3db0-4eba-9428-2ae3381372a4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.204692 Sep 24 14:26:44.669443 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 29/66] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:44 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:45.258805 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:45.259525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:45.265663 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=4 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:45.267218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:45.277518 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:45.280632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:45.281587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:45.284514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:45.285227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:45.286715 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:45.421206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:45.421822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:45.431185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:45.431599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:45.432041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:45.432736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:45.433248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:45.434891 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:45.720055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:45.729414 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6ea1b006-d0a4-4d84-bedc-295f1a717be8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.476879 Sep 24 14:26:45.730777 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 38/67] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:45 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:45.737522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:45.738485 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:45.761391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:45.761796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:45.762226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:45.762985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:45.763428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:45.764021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:45.787822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:45.796894 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:45.808767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:45.811875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a5aeaeba-d508-4bc0-bcda-62c8411a4767 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.394365 Sep 24 14:26:45.821134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 30/68] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:45 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:46.009125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:46.024992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6c978771-1ffb-43a3-a7e0-d8c76d9f1bed tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.290745 Sep 24 14:26:46.026884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 39/69] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:45 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:46.257798 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-3f67419d-8827-49b7-8780-2bdb87d1d1d1 req-e160c516-521d-4661-b351-6fef52bc8ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153f3eef-0f34-4a4a-8738-274bcb2737ca", "tag": "42c66fed-6127-4d44-b2b2-1f1ddaf5a32d"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:26:46.277679 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3f67419d-8827-49b7-8780-2bdb87d1d1d1 req-e160c516-521d-4661-b351-6fef52bc8ca1 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:46.278419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3f67419d-8827-49b7-8780-2bdb87d1d1d1 req-e160c516-521d-4661-b351-6fef52bc8ca1 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:46.280410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3f67419d-8827-49b7-8780-2bdb87d1d1d1 req-e160c516-521d-4661-b351-6fef52bc8ca1 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:46.307758 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-3f67419d-8827-49b7-8780-2bdb87d1d1d1 req-e160c516-521d-4661-b351-6fef52bc8ca1 service nova] Creating event network-changed:42c66fed-6127-4d44-b2b2-1f1ddaf5a32d for instance 153f3eef-0f34-4a4a-8738-274bcb2737ca on hv-cinder-85919 Sep 24 14:26:46.323948 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-3f67419d-8827-49b7-8780-2bdb87d1d1d1 req-e160c516-521d-4661-b351-6fef52bc8ca1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071950 Sep 24 14:26:46.326528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 31/70] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:26:46.753202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:46.753939 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:46.760824 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:46.761222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:46.761706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:46.762405 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:46.762925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:46.763349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:46.837838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:46.838538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:46.857094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:46.857996 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:46.859425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:46.860171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:46.860873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:46.861660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:46.916004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:46.927344 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-14d80d7d-2bfa-452b-bc7e-120c76573603 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.178514 Sep 24 14:26:46.929332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 40/71] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:46 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:47.041026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:47.049679 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:47.054336 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:47.061389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:47.062857 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:47.063964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6819bbeb-32c8-4f5b-9dfc-49b5835972ee tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.231112 Sep 24 14:26:47.064521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 32/72] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:46 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:47.069636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:47.070183 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:47.070538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:47.071259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:47.071706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:47.072123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:47.215532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:47.225524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e693f1e3-cab8-4b8f-a63b-fdff87e7134a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.180617 Sep 24 14:26:47.226541 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 41/73] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:47 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:47.952444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:47.953065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:47.955839 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:47.962053 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:47.962615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:47.963080 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:47.963774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:47.964222 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:47.964645 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:48.091406 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:48.092008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:48.098105 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:48.098829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:48.099446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:48.100872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:48.101327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:48.101933 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:48.152633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:48.161188 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e53b7de0-0e7a-4e45-ae29-a7abd5362024 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.212661 Sep 24 14:26:48.161752 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 33/74] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:47 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:48.250132 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:48.251143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:48.257742 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:48.258444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:48.259141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:48.259879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:48.260444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:48.260906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:48.261411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:48.269404 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:48.271354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:48.284402 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-482ef78b-6894-49b7-8356-5f2c712b2fdc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.185163 Sep 24 14:26:48.304091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 42/75] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:48 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:48.621983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:48.631136 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6b0df2ec-fc9f-4350-a2e1-f5acb8f9fcad tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.385495 Sep 24 14:26:48.643337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 34/76] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:48 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:49.192640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:49.193250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:49.200258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:49.200955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:49.201662 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:49.202532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:49.203220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:49.203644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:49.314677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:49.316178 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:49.323567 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:49.324043 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:49.324628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:49.325469 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:49.325912 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:49.326805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:49.461783 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:49.473755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6652d064-8912-4fd3-a381-9dd408b721c1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.287195 Sep 24 14:26:49.475473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 43/77] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:49 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:49.510625 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:49.520792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:49.525271 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:49.526594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-959141cc-6e81-4e36-8e8a-3e1eb28323ad tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.217820 Sep 24 14:26:49.527176 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 35/78] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:49 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:49.655636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:49.656349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:49.662480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:49.663300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:49.663800 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:49.664562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:49.665069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:49.665677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:49.828643 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:49.838792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ba092798-a8f0-42e2-a6c5-1e5672831a33 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.185486 Sep 24 14:26:49.840064 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 44/79] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:49 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:50.500075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:50.500745 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:50.507772 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:50.508289 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:50.508976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:50.510230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:50.511093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:50.511640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:50.564177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:50.564788 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:50.571140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:50.571625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:50.576951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:50.577720 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:50.578602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:50.579265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:50.704391 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:50.712650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1e0b9ae0-487d-4356-b698-c463398794f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.217565 Sep 24 14:26:50.713390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 36/80] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:50 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:26:50.776496 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:50.786393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:50.790207 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:50.792154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-278b97d8-f09d-4991-b156-3dcf969a3c68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.231647 Sep 24 14:26:50.800104 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 45/81] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:50 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:50.862065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:50.862557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:50.864556 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:50.870846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:50.871510 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:50.872032 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:50.873070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:50.873688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:50.877418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:51.016816 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:51.026003 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-18d16e2b-0f5f-4256-90ea-cd23afe147fc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.168160 Sep 24 14:26:51.026882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 37/82] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:50 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:51.737313 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:51.738125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:51.746069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:51.746943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:51.747705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:51.748725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:51.749180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:51.750254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:51.831528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:51.833287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:51.843074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:51.843812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:51.844469 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:51.845347 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:51.846903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:51.847519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:51.909759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:51.923850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4b8eec94-f0e9-497c-a6c0-f8c8e2042c79 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.190375 Sep 24 14:26:51.924375 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 46/83] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:51 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:51.998210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:52.012130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:52.013656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:52.015230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bcd622ef-4c97-4d0c-9d82-26fd6fe92ca7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.201875 Sep 24 14:26:52.016167 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 38/84] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:51 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:52.051582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:52.052456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:52.061398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:52.061884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:52.062527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:52.063409 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:52.064746 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:52.065167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:52.209885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:52.219521 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b8645399-e138-4990-9703-efbf36945ff9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.173594 Sep 24 14:26:52.220230 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 47/85] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:52 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:52.947863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:52.948410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:52.954134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:52.954622 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:52.955094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:52.955948 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:52.956662 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:52.957196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:53.040694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:53.041506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:53.048381 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:53.049106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:53.049738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:53.050611 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:53.051358 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:53.051879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:53.098157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:53.106408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9949b5c4-919f-46e3-bfc5-b0e76998d346 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.162933 Sep 24 14:26:53.107009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 39/86] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:52 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:53.181181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:53.189117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:53.190559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:53.191721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c0d42e44-e637-4402-8334-8ad2394c26da tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.155461 Sep 24 14:26:53.192271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 48/87] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:53 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:53.243458 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:53.244059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:53.249860 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:53.250367 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:53.250796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:53.251511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:53.251982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:53.252398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:53.376708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:53.384175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-286c72ad-1a60-4358-80b1-7e77585c33d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.145181 Sep 24 14:26:53.384726 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 40/88] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:53 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:54.129328 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:54.129864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:54.136280 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:54.136755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:54.137188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:54.137861 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:54.138310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:54.138730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:54.218380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:54.219026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:54.224959 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:54.225443 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:54.225876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:54.226564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:54.227040 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:54.227459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:54.264218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:54.267681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:54.273434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2c74baba-7dda-4685-85c9-34793751c2a0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.147967 Sep 24 14:26:54.274209 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 49/89] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:54 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:54.366931 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:54.374785 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:54.376247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:54.377345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e11b440e-b2b2-4bb5-a204-60eab3de7065 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.162893 Sep 24 14:26:54.377893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 41/90] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:54 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:26:54.406796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:54.407425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:54.413411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:54.413890 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:54.414325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:54.415033 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:54.415483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:54.415904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:54.545405 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:54.553493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-59c2f793-65d5-44f5-ad48-40efdb97d206 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.150742 Sep 24 14:26:54.554058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 50/91] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:54 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:55.296118 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:55.296667 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:55.302634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:55.303141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:55.303572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:55.304248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:55.304695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:55.305115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:55.403309 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:55.404018 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:55.410169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:55.410648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:55.411104 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:55.411778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:55.412780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:55.413195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:55.434047 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:55.441574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0c0ebfec-1974-4f58-9eb2-45a9475e0025 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.149314 Sep 24 14:26:55.442135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 42/92] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:55 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:55.537613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:55.545570 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:55.547103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:55.548173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2dd9997a-0344-449a-ad7f-7e58ca23e67b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.148685 Sep 24 14:26:55.548725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 51/93] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:55 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:55.576633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:55.577237 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:55.583081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:55.583563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:55.584589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:55.585267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:55.585715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:55.586134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:55.719447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:55.726978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3028991e-295e-4223-85e7-01cae24ab172 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.154032 Sep 24 14:26:55.727529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 43/94] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:55 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:56.463910 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:56.464516 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:56.470395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:56.470905 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:56.471339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:56.472021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:56.472469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:56.472886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:56.572988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:56.574152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:56.579955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:56.580430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:56.580854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:56.581545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:56.581985 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:56.582397 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:56.601995 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:56.611504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-eeeae0a5-09f1-48bf-b7ee-caa4fc24f449 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.151451 Sep 24 14:26:56.612445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 52/95] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:56 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:56.709050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:56.717484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:56.718883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:56.719963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7fc1862b-c4c2-4838-b867-f6a30999f574 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.150959 Sep 24 14:26:56.720632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 44/96] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:56 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:56.748604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:56.749208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:56.755017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:56.755496 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:56.755919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:56.756655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:56.757101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:56.757548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:56.885601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:56.893346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a286475b-81fb-48e9-9014-d55fd03f6f30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.148614 Sep 24 14:26:56.893896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 53/97] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:56 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:57.634350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:57.634999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:57.640892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:57.641374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:57.641806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:57.642493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:57.643017 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:57.643388 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:57.647393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:57.746305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:57.746838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:57.752675 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:57.753152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:57.753575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:57.754268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:57.754781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:57.755228 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:57.769681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:57.777163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dad07d67-8511-4a9e-8416-1b5dc3db2dbf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.147563 Sep 24 14:26:57.777716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 45/98] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:57 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:57.880244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:57.888125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:57.889556 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:57.890698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-31aea61c-3faa-4b19-a00c-655e3de8346d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.148557 Sep 24 14:26:57.891282 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 54/99] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:57 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:57.916967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:57.917669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:57.923511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:57.924079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:57.924573 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:57.925242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:57.925685 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:57.926100 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:58.059552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:58.067680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-76b5273a-49b8-4c6c-af54-59f576f458b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.154897 Sep 24 14:26:58.068496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 46/100] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:57 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:58.800761 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:58.801366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:58.807727 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:58.808206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:58.808635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:58.809315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:58.809765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:58.810188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:58.914913 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:58.915522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:58.921466 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:58.921888 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:58.922323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:58.923033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:58.923492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:58.923915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:58.938014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:58.946297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6c1c7da6-cfa1-4fd8-8959-9e5734f7fcca tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.149458 Sep 24 14:26:58.946878 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 55/101] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:58 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:59.047505 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:59.056018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:59.057466 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:59.058566 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3dea96c5-9e79-42ed-ab64-bdb0e748f46e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.147583 Sep 24 14:26:59.059159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 47/102] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:26:58 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:26:59.089258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:59.089859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:59.095689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:59.096186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:59.096634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:59.097306 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:59.097747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:59.098158 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:59.225706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:26:59.233420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-13e9b531-474f-4079-a0df-6e3930800505 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.147914 Sep 24 14:26:59.234052 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 56/103] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:59 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:26:59.968595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:26:59.969140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:26:59.975020 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:59.975503 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:59.975937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:26:59.976620 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:26:59.977066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:26:59.977483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:00.083753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:00.084358 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:00.090648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:00.091767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:00.092261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:00.092950 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:00.093395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:00.093812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:00.104175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:00.111821 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-50c1f9e2-3881-4af9-875d-f24c25db2073 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.147077 Sep 24 14:27:00.112373 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 48/104] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:26:59 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:00.218394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:00.226483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:00.227894 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:00.228982 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-76d9142a-7390-4144-a335-02dbfe384803 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.149171 Sep 24 14:27:00.229537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 57/105] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:00 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:00.259118 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:00.260128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:00.266098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:00.266679 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:00.267207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:00.267982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:00.268496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:00.269095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:00.403529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:00.411296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c86b218a-d32c-481a-a469-ed9584892d1a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.158844 Sep 24 14:27:00.411857 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 49/106] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:00 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:01.136446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:01.138014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:01.144066 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:01.144738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:01.145308 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:01.146247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:01.146769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:01.147799 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:01.253606 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:01.254126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:01.259986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:01.260460 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:01.260891 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:01.261568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:01.262011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:01.262423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:01.350873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:01.358752 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d1ad1d23-7391-4816-b516-1fe268bdb8cd tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.226485 Sep 24 14:27:01.362956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 58/107] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:01 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:01.406630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:01.418486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:01.419958 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:01.421325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3257e849-b9c7-45c4-8ac7-d907c91838d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.171691 Sep 24 14:27:01.422027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 50/108] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:01 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:01.434402 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:01.435473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:01.447206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:01.447206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:01.447206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:01.447206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:01.447712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:01.447712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:02.064157 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:02.073239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fddd9d1c-a756-4951-819e-a021a39b1542 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.643065 Sep 24 14:27:02.074325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 59/109] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:01 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:02.381653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:02.382388 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:02.388434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:02.389004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:02.389502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:02.390253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:02.390789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:02.391236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:02.447650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:02.449300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:02.457621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:02.458410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:02.459055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:02.461186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:02.461886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:02.462479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:02.553958 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:02.578727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5297c346-d8f0-4aa4-a03f-aa73aa88edf5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.186252 Sep 24 14:27:02.580099 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 51/110] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:02 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:02.652953 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:02.664888 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:02.666618 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:02.668166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-64ba6a1b-8226-40c5-9e00-b83591b113dd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.224313 Sep 24 14:27:02.669530 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 60/111] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:02 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:02.683666 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-7ba53966-354d-44ad-977d-bfa0310c5742 req-9806a4cd-650e-40fe-810b-feceb9084048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917f5416-f73d-496e-b89a-b62e69db68d8", "name": "network-vif-plugged", "status": "completed", "tag": "9ed51186-1d2e-4988-a33e-ce4caba1e8cf"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:02.693136 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7ba53966-354d-44ad-977d-bfa0310c5742 req-9806a4cd-650e-40fe-810b-feceb9084048 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:02.693767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7ba53966-354d-44ad-977d-bfa0310c5742 req-9806a4cd-650e-40fe-810b-feceb9084048 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:02.694288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7ba53966-354d-44ad-977d-bfa0310c5742 req-9806a4cd-650e-40fe-810b-feceb9084048 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:02.705474 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-7ba53966-354d-44ad-977d-bfa0310c5742 req-9806a4cd-650e-40fe-810b-feceb9084048 service nova] Creating event network-vif-plugged:9ed51186-1d2e-4988-a33e-ce4caba1e8cf for instance 917f5416-f73d-496e-b89a-b62e69db68d8 on hv-cinder-85919 Sep 24 14:27:02.711132 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-7ba53966-354d-44ad-977d-bfa0310c5742 req-9806a4cd-650e-40fe-810b-feceb9084048 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107016 Sep 24 14:27:02.711717 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 52/112] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:27:03.095861 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:03.096416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:03.102398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:03.103074 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:03.103503 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:03.104327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:03.104775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:03.105190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:03.240614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:03.248089 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c74273fb-757e-43b9-a0ec-c7bf0d6dacc5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.156018 Sep 24 14:27:03.248638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 61/113] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:03 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:03.603553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:03.604170 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:03.610227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:03.610702 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:03.611156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:03.611829 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:03.612280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:03.612693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:03.693480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:03.695425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:03.701316 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:03.701871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:03.702385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:03.703096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:03.703544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:03.703983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:03.738218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:03.746604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ed30c202-d05d-4633-be7f-32f3381122d0 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.147429 Sep 24 14:27:03.747223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 53/114] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:03 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:03.828489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:03.836763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:03.838190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:03.839350 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1510055b-b0b9-440d-a8e7-16fe84d77e89 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.149809 Sep 24 14:27:03.839896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 62/115] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:03 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:04.270409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:04.271048 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:04.277507 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:04.277978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:04.278405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:04.279106 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:04.279548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:04.279957 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:04.575994 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:04.583676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-753cbfef-17b0-4f10-9b4c-ced8caa3fec9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.317022 Sep 24 14:27:04.584232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 54/116] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:04 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:04.769677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:04.770189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:04.776735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:04.777207 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:04.777632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:04.778298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:04.778742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:04.779181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:04.863854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:04.864451 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:04.870748 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:04.871256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:04.871681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:04.872362 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:04.872797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:04.873213 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:04.909805 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:04.917506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2bb26148-9255-45d7-a0be-db2448afae7b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.151756 Sep 24 14:27:04.918067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 63/117] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:04 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:04.997380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:05.005593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:05.007688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:05.008788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-74b4edc6-1a69-431b-8076-27d254165dfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.148965 Sep 24 14:27:05.009349 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 55/118] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:04 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:05.607741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:05.608340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:05.614510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:05.615109 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:05.615535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:05.616201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:05.616673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:05.617086 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:05.740623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:05.748107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c3329577-68c4-4b56-abe7-b82223fdb25e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.144171 Sep 24 14:27:05.748672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 64/119] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:05 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:05.940272 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:05.940901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:05.947315 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:05.947799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:05.948230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:05.948933 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:05.949383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:05.949831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:06.033636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:06.034237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:06.040122 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:06.040599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:06.041026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:06.041708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:06.042152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:06.042573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:06.078950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:06.089772 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8bcccd3f-879a-4bc4-9c2e-daf85271dd1b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.153229 Sep 24 14:27:06.090525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 56/120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:05 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:06.178553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:06.186536 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:06.188014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:06.189099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5028e067-94b8-4533-93df-f4b51db0e504 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.159618 Sep 24 14:27:06.189650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 65/121] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:06 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:06.770431 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:06.771131 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:06.776982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:06.777454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:06.777876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:06.778541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:06.779012 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:06.779441 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:06.903831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:06.911538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-04c44cde-d0da-4078-975d-c426629a4583 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.144909 Sep 24 14:27:06.912083 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 57/122] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:06 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:07.112909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:07.113435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:07.119441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:07.119919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:07.120348 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:07.121045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:07.121491 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:07.121908 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:07.139714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:07.213863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:07.215244 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:07.221096 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:07.221570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:07.221991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:07.222658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:07.223122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:07.223535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:07.252682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:07.260393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-700e89ed-cace-40f3-aaee-08764946eaff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.151412 Sep 24 14:27:07.261048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 66/123] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:07 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:07.353563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:07.363499 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:07.364874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:07.365969 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f3e0d747-a48e-429b-92c1-d204a224b4a4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.156449 Sep 24 14:27:07.366518 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 58/124] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:07 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:07.934768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:07.935428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:07.942522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:07.943221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:07.943697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:07.944501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:07.944953 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:07.945407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:08.083970 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:08.092847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d606f816-2d57-4b4a-8084-b65304a67e08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.162472 Sep 24 14:27:08.093401 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 67/125] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:07 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:08.284057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:08.284654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:08.291031 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:08.291508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:08.291934 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:08.292604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:08.293046 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:08.293456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:08.390516 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:08.391175 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:08.397058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:08.397541 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:08.397973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:08.398658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:08.399177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:08.399595 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:08.432060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:08.440144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b002aeaa-87b0-4f1c-87e6-5419db51e982 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.159730 Sep 24 14:27:08.442960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 59/126] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:08 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:08.535191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:08.544294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:08.545820 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:08.547045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cf3b09e9-8ec7-4808-a4d9-3e4b4d2c7d1b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.160557 Sep 24 14:27:08.547640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 68/127] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:08 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:09.115634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:09.116237 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:09.122416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:09.123438 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:09.123893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:09.124674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:09.125217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:09.125836 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:09.281919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:09.296350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b2856235-bafa-428a-a270-42451fde5640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.184200 Sep 24 14:27:09.297618 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 60/128] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:09 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:09.464696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:09.465301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:09.476835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:09.479770 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:09.481974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:09.484560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:09.486236 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:09.486682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:09.573530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:09.574983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:09.581589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:09.582455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:09.583206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:09.584103 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:09.584641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:09.585199 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:09.707274 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:09.720422 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4ad3ecf4-704f-4e35-891a-63ff83778360 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.259420 Sep 24 14:27:09.721639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 69/129] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:09 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:09.760922 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:09.770615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:09.773396 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:09.774940 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a6d24a6e-3bab-4363-a0d6-a01ba122150f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.206297 Sep 24 14:27:09.776139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 61/130] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:09 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:10.324012 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:10.324370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:10.331200 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:10.332031 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:10.332767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:10.333572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:10.333889 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:10.334514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:10.490221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:10.500551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7fa1724b-c465-43d3-be00-d1dca4527c3b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.181000 Sep 24 14:27:10.502201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 70/131] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:10 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:10.746208 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:10.746808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:10.753830 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:10.754710 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:10.755231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:10.755994 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:10.756512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:10.757562 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:10.777936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:10.801904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:10.802553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:10.816036 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:10.817231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:10.817697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:10.818398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:10.819342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:10.820894 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:10.951459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:10.973658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a586efa2-bd48-4d10-86e7-935521246b49 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.231481 Sep 24 14:27:10.974639 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 62/132] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:10 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:11.009068 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:11.018213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:11.020850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:11.021980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1fa4cfc0-ba07-41b4-a132-a8bd1fa1a878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.224472 Sep 24 14:27:11.027286 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 71/133] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:10 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:11.532298 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:11.534544 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:11.560145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:11.562414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:11.563074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:11.571794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:11.574551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:11.575764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:11.741116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:11.750097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4b13a61c-43bd-41df-a17c-e6aabb2e917f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.228789 Sep 24 14:27:11.764858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 63/134] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:11 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:11.995862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:11.996513 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:12.002969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:12.003576 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:12.004271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:12.004972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:12.005423 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:12.005844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:12.046471 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:12.047102 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:12.053972 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:12.054687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:12.055214 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:12.056492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:12.057345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:12.057850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:12.167106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:12.176300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5620ec78-2a3f-499b-8fdc-bf8f599ef2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.184173 Sep 24 14:27:12.177597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 72/135] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:11 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:12.238545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:12.248318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:12.249695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:12.250938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-82059df1-2cdd-4118-b0eb-16c72c3ed62d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.208257 Sep 24 14:27:12.251695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 64/136] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:12 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:12.775405 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:12.776141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:12.782227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:12.782783 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:12.783565 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:12.784853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:12.784853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:12.785275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:12.968130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:12.986662 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c47d8b67-edf8-4204-875d-76f1ba5de25a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.215700 Sep 24 14:27:12.998996 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 73/137] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:12 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:13.201228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:13.202600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:13.208463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:13.208951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:13.209373 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:13.210275 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:13.210702 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:13.211318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:13.284621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:13.285632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:13.293207 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:13.293757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:13.294423 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:13.295154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:13.295604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:13.296030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:13.384487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:13.393352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-274fb1dd-8d8f-4044-b0a6-8994ae99b489 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.196659 Sep 24 14:27:13.394485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 65/138] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:13 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:13.466434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:13.475944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:13.477753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:13.478881 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fe8a12ad-6afa-4733-a337-773abb6f8d46 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.205908 Sep 24 14:27:13.479428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 74/139] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:13 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:14.010026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:14.010738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:14.017251 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:14.017741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:14.018381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:14.019127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:14.020098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:14.020532 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:14.174841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:14.184669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-404f7020-f1d4-45a6-9766-bb3f0f68aa00 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.178900 Sep 24 14:27:14.185440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 66/140] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:14 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:14.417951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:14.417951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:14.425120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:14.426565 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:14.427392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:14.428588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:14.429250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:14.429862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:14.506048 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:14.509049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:14.519098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:14.519606 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:14.520014 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:14.520842 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:14.521140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:14.521557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:14.647652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:14.660623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ee595424-2bd7-4642-afa9-c3eae961b2eb tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.244447 Sep 24 14:27:14.677001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 75/141] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:14 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:14.770878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:14.780826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:14.781809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:14.783394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b30e0b63-7e5a-41d3-ab91-31f087aba282 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.282184 Sep 24 14:27:14.784258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 67/142] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:14 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:15.218726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:15.219354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:15.225185 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:15.226156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:15.226582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:15.227282 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:15.227724 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:15.228137 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:15.372071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:15.380903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f73c8b03-6090-4de4-9972-771d2401743f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.166844 Sep 24 14:27:15.381470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 76/143] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:15 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:15.682842 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:15.683444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:15.689293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:15.689764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:15.690188 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:15.690867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:15.691311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:15.691721 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:15.809006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:15.809663 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:15.811701 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=78 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:15.821685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:15.821685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:15.821685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:15.821685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:15.822062 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:15.822062 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:15.851687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:15.873908 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-12a27e2f-abf1-41cd-a592-b934f36ff529 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.194719 Sep 24 14:27:15.875038 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 68/144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:15 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:16.117353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:16.125249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:16.126672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:16.127782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ad436c0c-f3f3-414c-b4b8-748aefca3a0f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.323142 Sep 24 14:27:16.128331 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 77/145] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:15 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:16.403497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:16.404321 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:16.410588 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:16.411291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:16.412062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:16.412411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-d95d2373-a3df-4ed6-b58c-8a65815e29c5 req-5c90bca8-8eb8-4ccc-a224-80bd255de3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153f3eef-0f34-4a4a-8738-274bcb2737ca", "name": "network-vif-plugged", "status": "completed", "tag": "42c66fed-6127-4d44-b2b2-1f1ddaf5a32d"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:16.413467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:16.413961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:16.414385 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:16.430619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d95d2373-a3df-4ed6-b58c-8a65815e29c5 req-5c90bca8-8eb8-4ccc-a224-80bd255de3f5 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:16.431559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d95d2373-a3df-4ed6-b58c-8a65815e29c5 req-5c90bca8-8eb8-4ccc-a224-80bd255de3f5 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:16.432254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d95d2373-a3df-4ed6-b58c-8a65815e29c5 req-5c90bca8-8eb8-4ccc-a224-80bd255de3f5 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:16.460836 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-d95d2373-a3df-4ed6-b58c-8a65815e29c5 req-5c90bca8-8eb8-4ccc-a224-80bd255de3f5 service nova] Creating event network-vif-plugged:42c66fed-6127-4d44-b2b2-1f1ddaf5a32d for instance 153f3eef-0f34-4a4a-8738-274bcb2737ca on hv-cinder-85919 Sep 24 14:27:16.469903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-d95d2373-a3df-4ed6-b58c-8a65815e29c5 req-5c90bca8-8eb8-4ccc-a224-80bd255de3f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064506 Sep 24 14:27:16.471288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 78/146] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:27:16.561331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:16.568797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cc4a6415-8a42-4894-8a38-6504b3d96dfc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.169415 Sep 24 14:27:16.569442 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 69/147] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:16 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:16.901986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:16.902852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:16.909816 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:16.910379 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:16.910831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:16.911590 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:16.912052 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:16.912477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:17.064968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:17.074947 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5dbb3d9a-4357-4dad-8c46-fc3c660736f5 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.177638 Sep 24 14:27:17.087264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 79/148] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:16 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:17.173023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:17.173728 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:17.182644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:17.183182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:17.183826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:17.184525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:17.184974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:17.185573 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:17.336267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:17.344427 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:17.345862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:17.346987 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8420cd46-5292-4eb7-b074-67a5b5b257fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.195314 Sep 24 14:27:17.347541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 70/149] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:17 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:17.590784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:17.591468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:17.598414 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:17.598682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:17.599204 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:17.599913 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:17.600439 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:17.600896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:17.738071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:17.746210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b8cacb36-ca45-422f-b0d6-2fe673b0428e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.159492 Sep 24 14:27:17.746963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 80/150] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:17 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:18.107638 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:18.108486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:18.111104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=76 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:18.117321 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:18.117812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:18.118244 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:18.119126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:18.119574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:18.119991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:18.253693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:18.261621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-984d5c89-840e-4358-8c39-68b4e4da0e1c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.162303 Sep 24 14:27:18.277227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 71/151] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:18 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:18.371178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:18.371916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:18.377963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:18.378444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:18.378891 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:18.379587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:18.380030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:18.380442 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:18.507520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:18.515416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:18.516839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:18.517914 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0bc5aa55-7a8e-44e1-9388-4b2fb8257260 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.150623 Sep 24 14:27:18.518459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 81/152] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:18 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:18.769913 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:18.770522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:18.777231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:18.777711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:18.778142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:18.778839 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:18.779292 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:18.779709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:18.914100 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:18.921753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-071cb635-acfa-4c6b-8165-8d3da6549ce9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.155766 Sep 24 14:27:18.922319 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 72/153] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:18 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:19.284967 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:19.285577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:19.291548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:19.292029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:19.292459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:19.293138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:19.293587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:19.294026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:19.434674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:19.442270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b0ea98a1-c188-4d4a-b2e2-f3e15085b172 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.161517 Sep 24 14:27:19.442855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 82/154] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:19 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:19.543886 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:19.544427 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:19.550239 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:19.550722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:19.551189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:19.551869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:19.552342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:19.552761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:19.680369 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:19.688854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:19.690310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:19.691421 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e1d2e4a1-3a18-430d-b994-aead087aa5d3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.151488 Sep 24 14:27:19.691970 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 73/155] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:19 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:27:19.944150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:19.944789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:19.950919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:19.951405 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:19.951833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:19.952512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:19.952956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:19.953369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:20.079170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:20.082612 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:20.088464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7c5b62eb-5ad0-4d95-b08a-3cc84a56392e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.148064 Sep 24 14:27:20.088960 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 83/156] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:19 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:20.465448 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:20.466043 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:20.474364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:20.474879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:20.475383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:20.476075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:20.476522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:20.476939 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:20.622709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:20.639639 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2ecd6145-5325-4fd7-a1ba-51767b97794c tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.178015 Sep 24 14:27:20.640223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 74/157] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:20 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:20.716569 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:20.717283 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:20.723253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:20.723739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:20.724175 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:20.724857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:20.725344 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:20.725764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:20.883436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:20.891557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:20.893010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:20.894103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3a09cacf-6ef3-4789-aad3-d635bd710481 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.181578 Sep 24 14:27:20.894660 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 84/158] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:20 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:21.111621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:21.112219 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:21.118704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:21.119205 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:21.119631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:21.120293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:21.120734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:21.121145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:21.247147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:21.254592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dc00e617-aa3d-425d-8330-eedaadd7ad6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.146799 Sep 24 14:27:21.255173 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 75/159] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:21 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:21.662092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:21.663322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:21.669155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:21.669628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:21.670050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:21.670716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:21.671192 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:21.671604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:21.794984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:21.802485 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5f7c52e5-364a-4b0d-9d69-f7d8ab95e030 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.144456 Sep 24 14:27:21.803082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 85/160] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:21 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:21.919420 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:21.920056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:21.925899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:21.926408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:21.926858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:21.927593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:21.928042 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:21.929016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:22.053424 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:22.061381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:22.062824 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:22.063911 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1e8ff175-cabe-4ff3-8145-d295a6f301c4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.148385 Sep 24 14:27:22.064483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 76/161] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:21 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:22.278083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:22.278626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:22.284849 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:22.285325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:22.285750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:22.286422 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:22.286884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:22.287302 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:22.420782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:22.433739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-609836cd-3039-430c-9809-ce7173ff2a72 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.159536 Sep 24 14:27:22.434426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 86/162] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:22 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:22.826608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:22.827243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:22.833226 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:22.833729 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:22.834163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:22.834873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:22.835324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:22.835741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:22.965658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:22.973199 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ccb83371-0cdf-4acc-a729-7c1e1e3fd607 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.151049 Sep 24 14:27:22.973744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 77/163] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:22 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:23.088252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:23.088853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:23.094720 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:23.095224 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:23.095646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:23.096315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:23.096755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:23.097166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:23.226785 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:23.235221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:23.236661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:23.237759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b43dc547-045a-4914-9971-9f956defa626 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.153359 Sep 24 14:27:23.238479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 87/164] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:23 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:23.457402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:23.458034 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:23.464420 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:23.464893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:23.465315 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:23.465980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:23.466420 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:23.466851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:23.593710 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:23.603227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cb14303f-b37f-4ab0-9fd4-30dd4079373d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.149586 Sep 24 14:27:23.603858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 78/165] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:23 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:23.995803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:23.996614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:24.002215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:24.002692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:24.003159 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:24.003856 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:24.004281 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:24.004695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:24.132478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:24.139951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cad2189d-d739-4e47-b08e-b5d344cdbd22 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.147923 Sep 24 14:27:24.140499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 88/166] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:23 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:24.263167 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:24.263771 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:24.269606 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:24.269980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:24.270407 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:24.271108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:24.271559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:24.272492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:24.276359 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:24.407566 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:24.414220 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:24.415667 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:24.416749 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-969c60d6-998f-4287-a26f-874a4b760b8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.157638 Sep 24 14:27:24.417284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 79/167] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:24 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:24.628815 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:24.629489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:24.635478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:24.635952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:24.636381 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:24.637063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:24.637507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:24.637931 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:24.764179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:24.771754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-171abcbe-b04e-45a2-8370-ed3dea1c0eaf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.148587 Sep 24 14:27:24.772950 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 89/168] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:24 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:25.162060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:25.162663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:25.168767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:25.169237 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:25.169659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:25.170351 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:25.171123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:25.171548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:25.308789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:25.316308 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-752a6370-56db-463c-be41-1431bb50cc13 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.158279 Sep 24 14:27:25.316869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 80/169] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:25 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:25.441039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:25.441641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:25.447452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:25.447926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:25.448347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:25.449013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:25.449453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:25.449867 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:25.573300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:25.581710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:25.583175 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:25.584268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b260f0eb-d77d-4296-9a54-72f44f6e8670 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.147127 Sep 24 14:27:25.584812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 90/170] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:25 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:25.795168 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:25.795881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:25.801826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:25.802393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:25.802954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:25.803698 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:25.804247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:25.804674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:25.934511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:25.941973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1299bcbd-6e03-45c7-af40-9706d1a1e02e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.150792 Sep 24 14:27:25.942528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 81/171] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:25 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:26.339974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:26.340485 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:26.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:26.346800 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:26.347254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:26.347917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:26.348357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:26.348773 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:26.475383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:26.483304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4e3149e1-e1f0-434e-b495-c512ee5ef569 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.147203 Sep 24 14:27:26.483960 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 91/172] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:26 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:26.609693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:26.610301 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:26.616783 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:26.617259 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:26.617689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:26.618359 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:26.618806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:26.619246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:26.752103 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:26.760961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:26.762411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:26.763558 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b467e688-3f38-4b99-84b1-8b6daf5a7ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.157818 Sep 24 14:27:26.764140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 82/173] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:26 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:26.964725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:26.965325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:26.971244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:26.971717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:26.972140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:26.972806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:26.973248 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:26.973662 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:27.098208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:27.106171 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-50eec0ed-1a39-4321-9f91-f7e20b2d365c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.145551 Sep 24 14:27:27.106721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 92/174] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:26 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:27.506394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:27.507093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:27.513024 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:27.513498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:27.513927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:27.514604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:27.515078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:27.515495 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:27.641123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:27.649311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-055d8bec-7b2a-418e-9988-ba0905b90524 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.146771 Sep 24 14:27:27.649852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 83/175] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:27 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:27.788171 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:27.788806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:27.794741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:27.795250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:27.795674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:27.796347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:27.796772 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:27.810424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:27.937631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:27.946055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:27.947537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:27.948630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ee6bddc2-80de-4ddc-9267-d16f2f1ab361 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.164286 Sep 24 14:27:27.949183 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 93/176] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:27 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:28.129279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:28.129881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:28.136317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:28.136317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:28.136317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:28.136317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:28.141961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:28.141961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:28.270624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:28.278186 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b284850e-39ed-4b62-a11b-bc2395cb2706 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.152750 Sep 24 14:27:28.278741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 84/177] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:28 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:28.658864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-e57ea2e3-00ba-4969-8ae1-1f0e3ea126b8 req-596e017a-f029-4d6b-a3e9-b1c105c2fa15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3aab52-9469-4a21-98ba-f83382ebf7ab", "name": "network-vif-plugged", "status": "completed", "tag": "812bad02-1d00-421a-acb7-00e2e9023540"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:28.672342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:28.672955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:28.678791 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-e57ea2e3-00ba-4969-8ae1-1f0e3ea126b8 req-596e017a-f029-4d6b-a3e9-b1c105c2fa15 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:28.684277 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:28.684765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:28.685196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:28.685878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:28.686328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:28.686742 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:28.687374 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-e57ea2e3-00ba-4969-8ae1-1f0e3ea126b8 req-596e017a-f029-4d6b-a3e9-b1c105c2fa15 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:28.687794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-e57ea2e3-00ba-4969-8ae1-1f0e3ea126b8 req-596e017a-f029-4d6b-a3e9-b1c105c2fa15 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:28.702233 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-e57ea2e3-00ba-4969-8ae1-1f0e3ea126b8 req-596e017a-f029-4d6b-a3e9-b1c105c2fa15 service nova] Creating event network-vif-plugged:812bad02-1d00-421a-acb7-00e2e9023540 for instance db3aab52-9469-4a21-98ba-f83382ebf7ab on hv-cinder-85919 Sep 24 14:27:28.707822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-e57ea2e3-00ba-4969-8ae1-1f0e3ea126b8 req-596e017a-f029-4d6b-a3e9-b1c105c2fa15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055044 Sep 24 14:27:28.708739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 94/178] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:27:28.822533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:28.830303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-023439e7-062c-430f-a16b-402bde49d3d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.162230 Sep 24 14:27:28.831084 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 85/179] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:28 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:28.974403 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:28.975186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:28.981803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:28.982280 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:28.982712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:28.983412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:28.983859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:28.984277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:29.110527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:29.118759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:29.120237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:29.121325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a32ec667-7e53-49f2-9707-4112de827b3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.151201 Sep 24 14:27:29.121873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 95/180] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:28 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:29.300236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:29.300845 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:29.307657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:29.308306 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:29.308777 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:29.309523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:29.310004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:29.310431 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:29.435801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:29.443317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5be7dbeb-9a6e-4d02-8601-137a7e38bf92 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.147060 Sep 24 14:27:29.443873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 86/181] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:29 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:29.854364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:29.855084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:29.861018 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:29.861533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:29.861965 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:29.862649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:29.863123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:29.863540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:30.018130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:30.028582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-026b7e2b-53e0-4a35-b1a2-abded45cb4bf tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.178804 Sep 24 14:27:30.029269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 96/182] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:29 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:30.146832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:30.148693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:30.156107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:30.156593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:30.157203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:30.158333 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:30.158973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:30.159548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:30.328580 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:30.339238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:30.341091 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:30.352578 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6ef0906c-71e5-41ee-a282-31188c2ca10c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.209842 Sep 24 14:27:30.353266 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 87/183] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:30 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:30.468256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:30.469087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:30.482440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:30.484378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:30.484929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:30.488671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:30.489282 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:30.492027 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:30.728922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:30.738054 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-186e9147-fe37-48dc-8a06-a6360ea0c20c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.275920 Sep 24 14:27:30.742639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 97/184] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:30 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:31.055850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:31.055850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:31.062285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:31.062944 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:31.063385 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:31.064081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:31.064658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:31.065351 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:31.229260 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:31.239674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9fced19b-c9ad-43ac-8843-c3894264a538 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1315 microversion: 2.1 time: 0.189044 Sep 24 14:27:31.240579 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 88/185] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:31 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:31.379735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:31.380333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:31.388341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:31.389189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:31.389800 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:31.390842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:31.391468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:31.392063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:31.593865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:31.602353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:31.603806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:31.604895 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-53013b0f-9612-4f6f-bf32-3517b60fb211 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.231091 Sep 24 14:27:31.605440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 98/186] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:31 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:31.766565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:31.767220 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:31.791155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:31.791649 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:31.792082 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:31.792802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:31.793238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:31.793654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:31.965841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:31.980098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-19767d8f-9cce-4b1b-9021-ce5efb0e361e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.218048 Sep 24 14:27:31.995412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 89/187] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:31 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:32.261520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:32.262192 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:32.268229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:32.268722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:32.269361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:32.270319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:32.271069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:32.271707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:32.435511 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:32.443627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-69f51f74-c586-4cda-aa9f-75ed465c20d3 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1500 microversion: 2.1 time: 0.186015 Sep 24 14:27:32.444513 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 99/188] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:32 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1500 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:32.631597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:32.632270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:32.642405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:32.643747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:32.646099 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:32.647023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:32.651143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:32.652401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:32.735143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-df56670d-f41b-4db3-934b-f03522abc6ae req-1ff647e2-bcf1-4d1d-9bd5-2a3506bc7def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f95b7f-2918-442c-ba7f-832ba9156e7d", "name": "network-vif-plugged", "status": "completed", "tag": "3c943efd-ace2-4916-8133-bc99ff2e01cf"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:32.748009 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-df56670d-f41b-4db3-934b-f03522abc6ae req-1ff647e2-bcf1-4d1d-9bd5-2a3506bc7def service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:32.748571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-df56670d-f41b-4db3-934b-f03522abc6ae req-1ff647e2-bcf1-4d1d-9bd5-2a3506bc7def service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:32.749081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-df56670d-f41b-4db3-934b-f03522abc6ae req-1ff647e2-bcf1-4d1d-9bd5-2a3506bc7def service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:32.764246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-df56670d-f41b-4db3-934b-f03522abc6ae req-1ff647e2-bcf1-4d1d-9bd5-2a3506bc7def service nova] Creating event network-vif-plugged:3c943efd-ace2-4916-8133-bc99ff2e01cf for instance c7f95b7f-2918-442c-ba7f-832ba9156e7d on hv-cinder-85919 Sep 24 14:27:32.774143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-df56670d-f41b-4db3-934b-f03522abc6ae req-1ff647e2-bcf1-4d1d-9bd5-2a3506bc7def service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044215 Sep 24 14:27:32.775182 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 100/189] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:27:32.819240 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:32.830452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:32.832738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:32.834227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bc542acd-2f6c-4a6c-bc22-dc4841447a64 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1408 microversion: 2.20 time: 0.207100 Sep 24 14:27:32.835322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 90/190] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:32 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:33.006305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:33.007542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:33.019293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:33.020181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:33.021501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:33.022179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:33.022789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:33.023470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:33.208164 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:33.213361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:33.218992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ed1826ac-3335-41ff-921f-18817965738c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.217626 Sep 24 14:27:33.219913 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 101/191] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:32 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:33.865141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:33.865754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:33.877537 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:33.878060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:33.878512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:33.879228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:33.879668 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:33.880087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:34.075404 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41297a27-3404-4be1-958b-c89fcf1c41cb"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:34.077907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:34.093264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:34.093517 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:34.094149 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:34.095063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:34.095524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:34.095956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:34.203193 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:34.224701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:34.228316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:34.232395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-202213e9-9903-4487-9f0e-b3f98c9fc9ab tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1599 microversion: 2.20 time: 0.370895 Sep 24 14:27:34.234055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 91/192] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:27:33 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1599 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:27:34.251156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:34.252793 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:34.268158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:34.269778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:34.270990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:34.273096 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:34.273647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:34.275023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:34.795674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:34.809508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-74e1f715-84c6-420d-8fe9-01d9ed7fd704 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.568972 Sep 24 14:27:34.810718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 92/193] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:34 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:34.834334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:34.835300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:34.856122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:34.857179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:34.857690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:34.859064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:34.860181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:34.860692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:35.130253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-281e7e0e-5600-41d7-8976-a2f02e975ef4 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.304581 Sep 24 14:27:35.130867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 93/194] 10.222.0.52 () {60 vars in 1316 bytes} [Sat Sep 24 14:27:34 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-interface => generated 284 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:27:35.838653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:35.840149 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:35.854662 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:35.863781 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:35.864674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:35.865782 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:35.873892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:35.874736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:36.169831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:36.197030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fe85a847-fe5e-4bef-88c4-36a3af906660 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.361011 Sep 24 14:27:36.207471 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 94/195] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:35 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:36.248030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-535f5175-d83a-4ed8-8f49-9c6aba0b682b tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "POST /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.175664 Sep 24 14:27:36.250279 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 102/196] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:27:34 2022] POST /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8/os-volume_attachments => generated 194 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:27:37.243485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:37.244085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:37.255008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:37.256942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:37.257781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-3db191e9-65aa-44fe-90f3-c3c5c92e6ac9 req-90eec232-7169-40ac-bae7-5c57a2756310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153f3eef-0f34-4a4a-8738-274bcb2737ca", "tag": "42c66fed-6127-4d44-b2b2-1f1ddaf5a32d"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:37.261044 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:37.262144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:37.263434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:37.265732 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:37.276782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-3db191e9-65aa-44fe-90f3-c3c5c92e6ac9 req-90eec232-7169-40ac-bae7-5c57a2756310 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:37.277364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-3db191e9-65aa-44fe-90f3-c3c5c92e6ac9 req-90eec232-7169-40ac-bae7-5c57a2756310 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:37.277898 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-3db191e9-65aa-44fe-90f3-c3c5c92e6ac9 req-90eec232-7169-40ac-bae7-5c57a2756310 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:37.304048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-3db191e9-65aa-44fe-90f3-c3c5c92e6ac9 req-90eec232-7169-40ac-bae7-5c57a2756310 service nova] Creating event network-changed:42c66fed-6127-4d44-b2b2-1f1ddaf5a32d for instance 153f3eef-0f34-4a4a-8738-274bcb2737ca on hv-cinder-85919 Sep 24 14:27:37.324509 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-3db191e9-65aa-44fe-90f3-c3c5c92e6ac9 req-90eec232-7169-40ac-bae7-5c57a2756310 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071122 Sep 24 14:27:37.325117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 103/197] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:27:37.519122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:37.529134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-959b3a70-edd3-4438-a9ac-7ea5f682e125 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1322 microversion: 2.1 time: 0.295232 Sep 24 14:27:37.530234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 95/198] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:37 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:38.554408 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:38.555792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:38.576669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:38.577415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:38.578016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:38.579136 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:38.579792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:38.580470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:38.755780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:38.769777 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6cd44a67-4b22-44bf-9edc-333550f67358 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1515 microversion: 2.1 time: 0.219915 Sep 24 14:27:38.770607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 104/199] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:38 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:38.797421 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:38.800359 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:38.806629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:38.807315 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:38.807740 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:38.816161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:38.816651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:38.817346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:38.821585 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:38.844040 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-124304003", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "networks": [{"uuid": "a32ad358-eeec-447f-91f8-a6f31db4b6a2"}]}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:38.847597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lazy-loading 'flavor' on Instance uuid c7f95b7f-2918-442c-ba7f-832ba9156e7d {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:27:38.923538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] validate_networks() for [('a32ad358-eeec-447f-91f8-a6f31db4b6a2', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:27:39.034029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5bd0fcfd-4d66-4abb-80e4-efaa580727d3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d/action" status: 200 len: 32 microversion: 2.1 time: 0.240264 Sep 24 14:27:39.039403 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 96/200] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:27:38 2022] POST /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d/action => generated 32 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:27:39.056628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:39.057714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:39.067847 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:39.069436 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:39.071139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:39.071974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:39.073151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:39.073828 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:39.274547 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:39.285050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-77b97398-7da2-4b82-afd6-06f88945b640 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.244345 Sep 24 14:27:39.303215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 97/201] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:39 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:40.128124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:27:40.128651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:27:40.129286 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:27:40.129833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:27:40.130382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:27:40.145047 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:40.145526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:40.146081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:40.146669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:40.147682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:40.148104 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:40.169930 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Getting quotas for project 27e584f45faa47afa4ced9db997f4e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:27:40.174626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Getting quotas for user d381a365e0744834b716fa6b0ea18d3d and project 27e584f45faa47afa4ced9db997f4e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:27:40.201766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:27:40.205072 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:27:40.312045 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:40.315445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:40.318457 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3248d18c-8324-47d7-870b-2d099389ce26 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478366 Sep 24 14:27:40.326332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 105/202] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:27:40.332429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:40.333356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:40.333950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:40.335483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:40.336094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:40.336855 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:40.339833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a0db5b20-ad27-4883-9750-f041330e77ab tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:40.340466 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a0db5b20-ad27-4883-9750-f041330e77ab tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:40.512089 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:40.524051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-52778ff4-1ff6-47e4-889b-2732cf03c196 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.218365 Sep 24 14:27:40.525294 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 98/203] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:40 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:40.548908 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a0db5b20-ad27-4883-9750-f041330e77ab tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:40.560501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a0db5b20-ad27-4883-9750-f041330e77ab tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1218 microversion: 2.1 time: 0.233435 Sep 24 14:27:40.561685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 106/204] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:40 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1218 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:41.550576 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:41.552428 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:41.561956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:41.562627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:41.563191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:41.564013 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:41.564569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:41.565022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:41.590774 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:41.591781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:41.599902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:41.600753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:41.601429 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:41.602320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:41.603037 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:41.603967 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:41.698871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:41.707847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-dcace37e-5470-4699-b660-c377509aafc4 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1270 microversion: 2.1 time: 0.123789 Sep 24 14:27:41.708420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 107/205] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:41 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:41.815511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:41.829082 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0c361504-4576-4a9a-914d-c78912637fe2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.282982 Sep 24 14:27:41.833295 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 99/206] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:41 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:42.732386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:42.733835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:42.742466 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:42.743267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:42.743707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:42.744441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:42.744896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:42.745328 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:42.862142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:42.864193 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:42.873365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:42.874265 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:42.875314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:42.878064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:42.879129 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:42.879749 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:43.001647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:43.014000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a73b299a-01c8-4866-a550-7730b2b33f1a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.287001 Sep 24 14:27:43.015130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 108/207] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:42 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:43.049244 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:43.060543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d9d7c349-57ec-4cf6-bc9c-017099d351c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.203533 Sep 24 14:27:43.071133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 100/208] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:42 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:43.659285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-2703cdd0-4c61-443b-bba7-3cfe06eb6be7 req-8381cbbb-84b8-48b3-89c1-40e4261d55f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952", "tag": "6536c4db-7f73-4444-affe-19257ef170a5"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:43.676346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-2703cdd0-4c61-443b-bba7-3cfe06eb6be7 req-8381cbbb-84b8-48b3-89c1-40e4261d55f6 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:43.676812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-2703cdd0-4c61-443b-bba7-3cfe06eb6be7 req-8381cbbb-84b8-48b3-89c1-40e4261d55f6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:43.677252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-2703cdd0-4c61-443b-bba7-3cfe06eb6be7 req-8381cbbb-84b8-48b3-89c1-40e4261d55f6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:43.688151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-2703cdd0-4c61-443b-bba7-3cfe06eb6be7 req-8381cbbb-84b8-48b3-89c1-40e4261d55f6 service nova] Creating event network-changed:6536c4db-7f73-4444-affe-19257ef170a5 for instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 on hv-cinder-85919 Sep 24 14:27:43.692893 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-2703cdd0-4c61-443b-bba7-3cfe06eb6be7 req-8381cbbb-84b8-48b3-89c1-40e4261d55f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037662 Sep 24 14:27:43.693476 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 109/209] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:27:44.042601 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:44.043300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:44.049158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:44.049641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:44.050069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:44.050743 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:44.051223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:44.051640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:44.096560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:44.097373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:44.103625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:44.104174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:44.104669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:44.105458 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:44.105922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:44.106402 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:44.187183 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:44.195465 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ebb7a55b-1d93-4222-a280-d825bb8f1b65 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.156708 Sep 24 14:27:44.196398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 101/210] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:44 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:44.248038 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:44.255766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a8d8e338-b5b8-413d-9776-9991d61e7aa7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.163919 Sep 24 14:27:44.256350 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 110/211] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:44 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:45.219318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:45.219860 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:45.225637 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:45.226111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:45.226535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:45.227262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:45.227708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:45.228119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:45.278177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:45.278780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:45.286027 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:45.286027 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:45.286375 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:45.287331 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:45.287574 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:45.287994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:45.355112 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:45.362719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e919a0bf-d390-4445-b139-ee8cc3d03c53 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.147211 Sep 24 14:27:45.363317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 102/212] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:45 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:45.417301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:45.424850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6a9e8d53-e7de-4f06-b6a1-d167e40c7f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.150506 Sep 24 14:27:45.425409 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 111/213] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:45 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:46.385816 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:46.386452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:46.392453 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:46.392927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:46.393361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:46.394030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:46.394476 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:46.394917 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:46.448731 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:46.449353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:46.451767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:46.456946 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:46.457423 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:46.457851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:46.458531 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:46.459001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:46.459995 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:46.523405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:46.531060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-914183ce-6e16-400b-963c-83ea07972053 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.148997 Sep 24 14:27:46.531623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 103/214] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:46 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:46.584282 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:46.592359 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-630921a9-c105-4810-9909-767b515ccebc tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.147473 Sep 24 14:27:46.592911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 112/215] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:46 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:47.553630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:47.554228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:47.560157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:47.560628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:47.561051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:47.561713 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:47.562151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:47.562561 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:47.616573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:47.617102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:47.624147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:47.624695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:47.625298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:47.626168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:47.626753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:47.627344 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:47.699990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:47.707712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d7e5439b-0306-4822-80d2-aba2d0d7ec6f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.158078 Sep 24 14:27:47.708274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 104/216] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:47 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:47.758296 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:47.765751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6ec7f6cd-3193-4d3a-b94d-74a6466dc356 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.153291 Sep 24 14:27:47.766308 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 113/217] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:47 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:48.731404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:48.732067 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:48.734003 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=68 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:48.739146 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:48.739654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:48.740084 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:48.740848 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:48.741948 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:48.742368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:48.789588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:48.790220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:48.796638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:48.797117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:48.797553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:48.798227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:48.798674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:48.799117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:48.877696 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:48.886764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fb62da70-1243-428b-8e98-29d1ddd526a7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.159209 Sep 24 14:27:48.887363 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 105/218] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:48 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:48.930717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:48.938697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-22d83e15-fc5a-4c1d-bf19-62f6b9907cb9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.153428 Sep 24 14:27:48.939334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 114/219] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:48 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:49.909711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:49.910318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:49.916227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:49.916709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:49.917140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:49.917845 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:49.918294 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:49.918709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:49.966177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:49.967499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:49.982174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:49.982670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:49.983329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:49.984039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:49.984659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:49.985088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:50.082921 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:50.093978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ad720006-86ce-4289-99f0-4d3ee2fb6fb6 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.188298 Sep 24 14:27:50.095107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 106/220] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:49 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:50.150452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:50.158461 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-78486ffe-a16e-4b78-a1b3-27b7b708338f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.199435 Sep 24 14:27:50.159215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 115/221] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:49 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:51.116537 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:51.117264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:51.126528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.127236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.127672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.128350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.128791 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.129195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.184568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:51.186706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:51.193294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:51.195821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=8 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:51.198799 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.200324 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.201291 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.202276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.202838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.203319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.280822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:51.292204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d37895fb-b92a-46fd-954c-50b7befa0e1c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.178696 Sep 24 14:27:51.293497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 107/222] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:51 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:51.384437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:51.395230 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4e7b5e04-1feb-4271-af64-9310fb02a523 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.215763 Sep 24 14:27:51.411401 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 116/223] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:51 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:51.566538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:51.566976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:51.573408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.573893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.574322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.575206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.575656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.576076 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.603747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:27:51.711738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-53912ade-a35b-42cf-b2fb-4da2a87427ff tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 204 len: 0 microversion: 2.1 time: 0.148725 Sep 24 14:27:51.712614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 108/224] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:27:51 2022] DELETE /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:27:51.720420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:51.721397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:51.728982 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.729961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.730645 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.731645 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:51.732321 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:51.733957 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:51.899683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:51.910007 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3f655571-e21e-4804-ac62-5dbf7dc73e81 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1552 microversion: 2.1 time: 0.193230 Sep 24 14:27:51.915533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 117/225] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:51 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1552 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:52.320415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:52.321729 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:52.328931 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:52.329446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:52.329882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:52.330575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:52.337901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:52.338394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:52.343059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:52.417433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:52.418729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:52.425321 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:52.425801 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:52.426224 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:52.427083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:52.427698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:52.428266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:52.544627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:52.553428 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e0fa5aba-e5f0-464d-9a9e-7f504fef9e73 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.240478 Sep 24 14:27:52.554113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 109/226] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:52 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:52.588091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:52.597206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3498ae24-fe71-43cf-a3fc-2dd988a89230 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.183400 Sep 24 14:27:52.598488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 118/227] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:52 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:52.934532 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:52.935192 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:52.941655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:52.942141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:52.943133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:52.943712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:52.944231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:52.945128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:53.095956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:53.111708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dd91b02c-27b6-4bce-8d18-be00f950b301 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1552 microversion: 2.1 time: 0.181350 Sep 24 14:27:53.112565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 110/228] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:52 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:53.590155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:53.591662 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:53.601597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:53.602296 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:53.602886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:53.603607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:53.604176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:53.604838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:53.622752 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:53.623514 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:53.630978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:53.631892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:53.632709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:53.633797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:53.634340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:53.635112 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:53.806077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:53.815506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-25c856ba-c7e8-438f-8acd-aecc43b4f83c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.242121 Sep 24 14:27:53.827213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 119/229] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:53 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:54.038217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:54.046972 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3f3c040f-3b21-4658-9fc5-b77cd9645fda tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.429245 Sep 24 14:27:54.058836 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 111/230] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:53 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:54.136496 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:54.137081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:54.142966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:54.143441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:54.143864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:54.144534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:54.144977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:54.145390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:54.149871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:54.273651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:54.281687 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-941c5b19-dc8f-432b-8bcb-715acbc1001e tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1552 microversion: 2.1 time: 0.149728 Sep 24 14:27:54.282247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 120/231] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:54 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:54.841776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:54.842202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:54.848256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:54.848746 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:54.849181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:54.849872 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:54.850865 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:54.851307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:54.986429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:54.994744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-64ac4211-449a-4e41-bbf3-513fde0e6a23 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.157513 Sep 24 14:27:54.995337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 112/232] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:54 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:55.071175 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:55.072520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:55.078916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:55.079682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:55.080129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:55.081010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:55.081632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:55.082676 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:55.257973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:55.266307 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9a96e5e7-a0b7-483a-ac2b-6a6788d7cbf7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.199156 Sep 24 14:27:55.269342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 121/233] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:55 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:55.304927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:55.305808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:55.312583 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:55.313154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:55.313809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:55.314734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:55.315402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:55.316012 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:55.719049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:55.728799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2f0331ae-c210-4ec5-a5b2-d8af74402ea8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1552 microversion: 2.1 time: 0.427772 Sep 24 14:27:55.729390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 113/234] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:55 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1552 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:56.017722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:56.019101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:56.033540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:56.035225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:56.035792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:56.036646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:56.037459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:56.037930 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:56.242145 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:56.250405 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-498ba116-6992-4b70-95d0-7c2caedff9cd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.236624 Sep 24 14:27:56.259432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 122/235] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:56 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:56.295461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:56.296162 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:56.305425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:56.305425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:56.305692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:56.306734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:56.307519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:56.307982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:56.477910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:56.490444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a91b4520-5862-45f8-9b6f-1fc1505d8201 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.199669 Sep 24 14:27:56.493014 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 114/236] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:56 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:56.754611 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:56.755872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:56.762368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:56.777304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:56.778979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:56.780353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:56.781397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:56.781949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:57.108949 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-324ddf70-ee16-4a4d-a0fe-e4941c238731 req-b8926f96-fc45-4973-a10c-6c7ccbe6d8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952", "name": "network-vif-plugged", "status": "completed", "tag": "6536c4db-7f73-4444-affe-19257ef170a5"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:57.125368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-324ddf70-ee16-4a4d-a0fe-e4941c238731 req-b8926f96-fc45-4973-a10c-6c7ccbe6d8b2 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:57.126310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-324ddf70-ee16-4a4d-a0fe-e4941c238731 req-b8926f96-fc45-4973-a10c-6c7ccbe6d8b2 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:57.127101 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-324ddf70-ee16-4a4d-a0fe-e4941c238731 req-b8926f96-fc45-4973-a10c-6c7ccbe6d8b2 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:57.142624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-324ddf70-ee16-4a4d-a0fe-e4941c238731 req-b8926f96-fc45-4973-a10c-6c7ccbe6d8b2 service nova] Creating event network-vif-plugged:6536c4db-7f73-4444-affe-19257ef170a5 for instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 on hv-cinder-85919 Sep 24 14:27:57.153559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-324ddf70-ee16-4a4d-a0fe-e4941c238731 req-b8926f96-fc45-4973-a10c-6c7ccbe6d8b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048993 Sep 24 14:27:57.156519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 115/237] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:27:57.267816 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:57.276875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:57.280750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:57.295831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ae28612a-24cf-4af3-9c1f-e4e0bcd95a76 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1552 microversion: 2.1 time: 0.545747 Sep 24 14:27:57.302106 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:57.303846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 123/238] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:56 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1552 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:27:57.309426 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:57.310182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:57.311903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:57.315001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:57.317597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:57.515533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:57.516934 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:57.528415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:57.529103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:57.529725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:57.530724 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:57.531359 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:57.532011 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:57.572447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:57.584577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-34904887-f087-4480-bb54-b40fb6e6d1ba tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.313138 Sep 24 14:27:57.599816 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 116/239] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:57 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:57.851442 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e7d72dbc-8b98-48c8-9f3c-3d182ac94818 req-e4a79fe1-e38d-4ea8-ac89-37c37ed3cf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917f5416-f73d-496e-b89a-b62e69db68d8", "name": "network-vif-deleted", "tag": "9ed51186-1d2e-4988-a33e-ce4caba1e8cf"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:27:57.875665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e7d72dbc-8b98-48c8-9f3c-3d182ac94818 req-e4a79fe1-e38d-4ea8-ac89-37c37ed3cf84 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:57.878255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e7d72dbc-8b98-48c8-9f3c-3d182ac94818 req-e4a79fe1-e38d-4ea8-ac89-37c37ed3cf84 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:57.878702 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e7d72dbc-8b98-48c8-9f3c-3d182ac94818 req-e4a79fe1-e38d-4ea8-ac89-37c37ed3cf84 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:57.910403 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e7d72dbc-8b98-48c8-9f3c-3d182ac94818 req-e4a79fe1-e38d-4ea8-ac89-37c37ed3cf84 service nova] Creating event network-vif-deleted:9ed51186-1d2e-4988-a33e-ce4caba1e8cf for instance 917f5416-f73d-496e-b89a-b62e69db68d8 on hv-cinder-85919 Sep 24 14:27:57.917517 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e7d72dbc-8b98-48c8-9f3c-3d182ac94818 req-e4a79fe1-e38d-4ea8-ac89-37c37ed3cf84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071115 Sep 24 14:27:57.921267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 117/240] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:27:57.930957 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:57.941391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b69f6baf-e357-4c78-aa3f-0120f8094acb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.430253 Sep 24 14:27:57.942584 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 124/241] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:57 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:58.327423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:58.328123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:58.334641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:58.335156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:58.335581 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:58.336553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:58.337288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:58.338224 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:58.419121 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:58.429155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1b91af52-7ca4-4cd8-90f2-a61f230d172f tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1346 microversion: 2.1 time: 0.105503 Sep 24 14:27:58.430248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 118/242] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:58 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:58.614046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:58.614668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:58.622497 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:58.623028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:58.623464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:58.624163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:58.624614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:58.625035 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:58.807610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:58.818588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7f8b6f1c-3f78-4e76-82fe-3ca07b860cb1 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1318 microversion: 2.1 time: 0.208932 Sep 24 14:27:58.831115 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 125/243] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:58 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:58.966114 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:58.966893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:58.973880 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:58.974485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:58.975232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:58.976550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:58.977009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:58.977527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:59.111578 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:59.121910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-443ec3ab-5e4c-4127-af87-b3bfa29d30ae tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.160278 Sep 24 14:27:59.122513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 119/244] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:58 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:59.452354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:59.452995 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:59.461944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:59.462435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:59.463789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:59.464501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:59.464970 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:59.465393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:59.501060 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:59.501542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:59.501975 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:59.502428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lazy-loading 'fault' on Instance uuid 917f5416-f73d-496e-b89a-b62e69db68d8 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:27:59.546569 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:27:59.556361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-57a2563f-ab3c-4c6d-b16c-4b9ae357b9d1 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1351 microversion: 2.1 time: 0.108565 Sep 24 14:27:59.556925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 126/245] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:59 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:27:59.844023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:27:59.844954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:27:59.852412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:59.852918 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:59.853514 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:27:59.854337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:27:59.863074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:27:59.863074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:00.041597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:00.049802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1f08497d-b246-4cd9-94ae-c8df356fc292 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1507 microversion: 2.1 time: 0.209754 Sep 24 14:28:00.069419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 120/246] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:27:59 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:00.146143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:00.147127 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:00.155972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:00.156620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:00.157058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:00.158055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:00.158528 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:00.159016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:00.326472 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:00.336104 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-dddf6a16-da18-4553-9dd1-9f5bb58bf3b0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.194124 Sep 24 14:28:00.339324 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 127/247] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:00 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:00.589134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:00.590564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:00.598041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:00.599026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:00.599638 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:00.601401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:00.602163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:00.602793 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:00.672131 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:00.672786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:00.673359 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:00.673933 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lazy-loading 'fault' on Instance uuid 917f5416-f73d-496e-b89a-b62e69db68d8 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:28:00.738572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75575c10a8eb4ebfab5b2f0c330541df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb2f863f5834cd4a47a3ed9feda7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:00.752150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-90322d29-3ec9-4b6b-a623-3afcd384918d tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 200 len: 1351 microversion: 2.1 time: 0.166161 Sep 24 14:28:00.753964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 121/248] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:00 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:01.360571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:01.361266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:01.379875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:01.381951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:01.382625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:01.383622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:01.384382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:01.384999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:01.537178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:01.547135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6b1fdbcd-e5ad-4c7c-8012-caa986d5703c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.190447 Sep 24 14:28:01.548378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 128/249] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:01 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:01.796805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:01.797318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:01.803574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:01.804062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:01.806452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:01.806452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:01.806452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:01.806452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:01.825825 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] HTTP exception thrown: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Request method failure captured: Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 HTTP/1.1 Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxOGE1-Ta1P36UrFYukKmq2rGbC5Uxlg4em0RU5xMyzevb306qbZeLgLBT0MMQDhE5p_Vp1yQhg52UIfhOLymvsmRD0MAk0XPRnB0tFczoTVAOptM00vtWkeYMXzvPtyiDDKVVgP6rCZedazhS554uduscqCgbkTwJLaqQzPL7gGjVY Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:28:01.832823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bb2f863f5834cd4a47a3ed9feda7c02", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bb2f863f5834cd4a47a3ed9feda7c02"}]}] Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: 75575c10a8eb4ebfab5b2f0c330541df Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:01.834151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '917f5416-f73d-496e-b89a-b62e69db68d8'} Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:28:01.835413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:01.836509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:01.839145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Returning 404 to user: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:28:01.840137 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6027d123-534f-45e1-8751-11edbd2477e8 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 404 len: 111 microversion: 2.1 time: 0.063339 Sep 24 14:28:01.840714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 122/250] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:01 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:28:02.163504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:02.166184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:02.172599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:02.173097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:02.173547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:02.174621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:02.175191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:02.175607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:02.189312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] HTTP exception thrown: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Request method failure captured: Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8/os-volume_attachments HTTP/1.1 Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOGE1-Ta1P36UrFYukKmq2rGbC5Uxlg4em0RU5xMyzevb306qbZeLgLBT0MMQDhE5p_Vp1yQhg52UIfhOLymvsmRD0MAk0XPRnB0tFczoTVAOptM00vtWkeYMXzvPtyiDDKVVgP6rCZedazhS554uduscqCgbkTwJLaqQzPL7gGjVY Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:28:02.193555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bb2f863f5834cd4a47a3ed9feda7c02", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bb2f863f5834cd4a47a3ed9feda7c02"}]}] Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 75575c10a8eb4ebfab5b2f0c330541df Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:02.195568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'server_id': '917f5416-f73d-496e-b89a-b62e69db68d8'} Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:28:02.196386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:02.197810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:02.199501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Returning 404 to user: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:28:02.199501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-66304039-1d18-40d6-9b90-2e492ce42509 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036127 Sep 24 14:28:02.199501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 129/251] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:28:02 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:28:02.573378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:02.573943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:02.579817 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:02.580292 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:02.580726 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:02.581403 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:02.581850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:02.582270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:02.708588 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:02.716130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-59510d14-ccc5-4b17-a759-50f8e29b68cf tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.147415 Sep 24 14:28:02.716683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 123/252] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:02 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:03.459167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:03.461127 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:03.469288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:03.469979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:03.471783 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:03.472875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:03.473878 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:03.474462 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:03.491741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] HTTP exception thrown: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Request method failure captured: Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 HTTP/1.1 Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOGE1-Ta1P36UrFYukKmq2rGbC5Uxlg4em0RU5xMyzevb306qbZeLgLBT0MMQDhE5p_Vp1yQhg52UIfhOLymvsmRD0MAk0XPRnB0tFczoTVAOptM00vtWkeYMXzvPtyiDDKVVgP6rCZedazhS554uduscqCgbkTwJLaqQzPL7gGjVY Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:28:03.494840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bb2f863f5834cd4a47a3ed9feda7c02", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bb2f863f5834cd4a47a3ed9feda7c02"}]}] Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 75575c10a8eb4ebfab5b2f0c330541df Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.496184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '917f5416-f73d-496e-b89a-b62e69db68d8'} Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:28:03.496846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.497956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.499153 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Returning 404 to user: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:28:03.499153 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-bf1a490a-49bd-4326-8cc7-21d5035692ac tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 404 len: 111 microversion: 2.1 time: 0.042284 Sep 24 14:28:03.499153 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 130/253] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:28:03 2022] DELETE /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:28:03.505755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:03.506453 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] [instance: 917f5416-f73d-496e-b89a-b62e69db68d8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:03.512709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:03.513501 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:03.514366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:03.515331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:03.515978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:03.516381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:03.534214 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] HTTP exception thrown: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Request method failure captured: Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 HTTP/1.1 Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxOGE1-Ta1P36UrFYukKmq2rGbC5Uxlg4em0RU5xMyzevb306qbZeLgLBT0MMQDhE5p_Vp1yQhg52UIfhOLymvsmRD0MAk0XPRnB0tFczoTVAOptM00vtWkeYMXzvPtyiDDKVVgP6rCZedazhS554uduscqCgbkTwJLaqQzPL7gGjVY Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:28:03.538169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bb2f863f5834cd4a47a3ed9feda7c02", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb2f863f5834cd4a47a3ed9feda7c02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bb2f863f5834cd4a47a3ed9feda7c02"}]}] Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 6bb2f863f5834cd4a47a3ed9feda7c02 Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-DeleteServersTestJSON-1610151557 Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: 75575c10a8eb4ebfab5b2f0c330541df Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-DeleteServersTestJSON-1610151557-project Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.539430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '917f5416-f73d-496e-b89a-b62e69db68d8'} Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:28:03.540140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. Sep 24 14:28:03.541331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:28:03.542299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] Returning 404 to user: Instance 917f5416-f73d-496e-b89a-b62e69db68d8 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:28:03.542299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9aad591b-b7d1-48ae-a3be-d4331514cd02 tempest-DeleteServersTestJSON-1610151557 tempest-DeleteServersTestJSON-1610151557-project] 10.222.0.52 "GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8" status: 404 len: 111 microversion: 2.1 time: 0.037768 Sep 24 14:28:03.542299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 124/254] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:03 2022] GET /compute/v2.1/servers/917f5416-f73d-496e-b89a-b62e69db68d8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:28:03.738081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:03.738517 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:03.745092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:03.745873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:03.746299 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:03.747219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:03.747671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:03.748087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:03.929268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:03.951957 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e995c7be-64cb-4918-8dba-bfe7b40f748e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.217356 Sep 24 14:28:03.953992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 131/255] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:03 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:04.982715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:04.983434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:04.989323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:04.989812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:04.990249 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:04.990961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:04.991418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:04.991862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:05.386529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:05.394480 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e043b389-278d-48cf-aede-dee7321b3378 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.415673 Sep 24 14:28:05.395310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 125/256] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:04 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:06.421587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:06.422374 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:06.430009 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:06.430419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:06.431166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:06.432339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:06.437155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:06.437778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:06.725714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:06.736089 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c09e5460-4962-4a53-8993-990e35a83294 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.319773 Sep 24 14:28:06.747094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 132/257] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:06 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:07.761777 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:07.762591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:07.771683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:07.772350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:07.774348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:07.775654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:07.776755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:07.777293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:08.197206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:08.204933 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c5e82179-2572-457f-8c1a-89f12df47e78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.448691 Sep 24 14:28:08.210855 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 126/258] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:07 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:28:09.238689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:09.239993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:09.249688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:09.250174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:09.251156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:09.252651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:09.253276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:09.253908 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:09.420979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:09.432665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-539a6e28-bf4e-476e-b866-0a40561f8b83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.199219 Sep 24 14:28:09.433246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 133/259] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:09 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:10.475454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:10.475454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:10.480169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:10.480169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:10.480169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:10.483263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:10.483802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:10.484355 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:10.686980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:10.695651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cf4a9c7a-cec0-4189-b162-9d6a28f8da08 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.242042 Sep 24 14:28:10.696221 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 127/260] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:10 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:11.718789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:11.722884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:11.729683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:11.730245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:11.730754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:11.731539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:11.732061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:11.732554 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:11.898625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:11.906903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0f6a5a43-e15e-42a1-89bf-86d148607ac8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.191818 Sep 24 14:28:11.907884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 134/261] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:11 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:12.933143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:12.933740 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:12.939999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:12.940478 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:12.940902 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:12.941864 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:12.942137 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:12.942670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:12.946864 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:13.075764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:13.085375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-16a67f73-4951-4000-a889-1dcd4c9182fa tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.156317 Sep 24 14:28:13.086130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 128/262] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:12 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:14.111811 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:14.112371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:14.119563 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:14.120051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:14.120484 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:14.121189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:14.121627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:14.122047 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:14.251952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:14.259657 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6b8d4f97-6e79-4c71-b503-87ac00d886d0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.151838 Sep 24 14:28:14.260221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 135/263] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:14 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:14.393813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c6f1a093-44ba-41e0-9995-6bb932879e0b tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222ac33670>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:14.442368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c6f1a093-44ba-41e0-9995-6bb932879e0b tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/910c7e7a-ff6e-4e60-928a-a7dfa3bf82d3" status: 200 len: 351 microversion: 2.1 time: 0.052284 Sep 24 14:28:14.442962 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 129/264] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:28:14 2022] GET /compute/v2.1/os-volumes/910c7e7a-ff6e-4e60-928a-a7dfa3bf82d3 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:28:15.286255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:15.286842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:15.293181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:15.293661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:15.294086 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:15.294757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:15.295226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:15.295640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:15.420134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:15.428225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9b71d73c-0598-446c-b0f6-9e1ddfd83b35 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.145697 Sep 24 14:28:15.428786 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 136/265] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:15 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:16.451063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:16.451661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:16.457754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:16.458296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:16.459320 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:16.460025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:16.460477 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:16.460897 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:16.584756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:16.592372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-65648818-2edf-42ec-a920-7e29a091b7e3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.145174 Sep 24 14:28:16.592931 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 130/266] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:16 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:17.615445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:17.616056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:17.618332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=52 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:17.623516 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:17.623994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:17.624425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:17.625108 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:17.625559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:17.625977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:17.754749 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:17.758744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:17.764010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5237dcb0-d0e6-430d-8e95-df96c41d3dc6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.152479 Sep 24 14:28:17.764566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 137/267] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:17 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:18.787303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:18.787953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:18.789936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:18.795031 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:18.795508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:18.795936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:18.796614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:18.797056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:18.797473 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:18.932655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:18.940502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-56de1619-a52a-429b-a5a9-5e1314c065c0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.157005 Sep 24 14:28:18.941057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 131/268] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:18 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:19.963255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:19.963873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:19.971389 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:19.971868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:19.972301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:19.973010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:19.973458 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:19.973988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:20.106126 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:20.113708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-21a7a05a-70e0-4fcd-8b3f-057a4946d877 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.154454 Sep 24 14:28:20.114266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 138/269] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:19 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:21.137242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:21.137838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:21.143864 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:21.144337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:21.144762 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:21.145449 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:21.145896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:21.147397 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:21.273672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:21.281283 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-88270f5e-d6c5-45fd-b6b8-02a6c615b362 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.147820 Sep 24 14:28:21.281854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 132/270] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:21 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:22.304545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:22.305126 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:22.312537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:22.313032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:22.313471 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:22.314177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:22.314618 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:22.315060 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:22.448910 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:22.457420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a84afe93-576b-402b-8b88-aff9223322a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.156601 Sep 24 14:28:22.458043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 139/271] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:22 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:23.481090 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:23.481690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:23.487794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:23.488272 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:23.488703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:23.489387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:23.489846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:23.490398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:23.622461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:23.630140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c7b0e159-b938-4ae9-a43e-5d7d417b20be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.152862 Sep 24 14:28:23.630694 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 133/272] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:23 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:24.654000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:24.654629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:24.661219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:24.661695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:24.662222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:24.662919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:24.663364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:24.663797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:24.794424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:24.801908 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-63f191f4-5071-4c50-869b-9b0cd233bd05 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.151780 Sep 24 14:28:24.802463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 140/273] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:24 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:25.277236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8895078e-3eec-49f9-81bc-c00f0fa990e7 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222abbd940>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:25.329410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8895078e-3eec-49f9-81bc-c00f0fa990e7 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/08ba66c0-7037-426e-8a7c-768754156e11" status: 200 len: 350 microversion: 2.1 time: 0.055973 Sep 24 14:28:25.329968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 134/274] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:28:25 2022] GET /compute/v2.1/os-volumes/08ba66c0-7037-426e-8a7c-768754156e11 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:28:25.826196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:25.826796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:25.833212 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:25.833698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:25.834136 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:25.834842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:25.835299 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:25.835726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:25.966834 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:25.974353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f942aa80-98c6-4bbe-b36b-2f4d1a789431 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.152062 Sep 24 14:28:25.974929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 141/275] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:25 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:26.999374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:26.999932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:27.005827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:27.006361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:27.006881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:27.007871 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:27.008564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:27.009016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:27.165151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:27.173296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0f2cc72d-dea5-4195-b606-a54946ee9d32 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.178035 Sep 24 14:28:27.173877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 135/276] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:26 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:27.735125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e086b703-5c36-4acc-a017-95d8fc266225 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222ac6be50>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:27.786063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e086b703-5c36-4acc-a017-95d8fc266225 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3214082a-2524-494a-8cd0-c3d9fbae7d4d" status: 200 len: 350 microversion: 2.1 time: 0.054884 Sep 24 14:28:27.786632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 142/277] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:28:27 2022] GET /compute/v2.1/os-volumes/3214082a-2524-494a-8cd0-c3d9fbae7d4d => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:28:27.800465 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7ad27a8b-bcc7-414b-b38b-fa869af75c64 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222ad1b940>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:27.888030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7ad27a8b-bcc7-414b-b38b-fa869af75c64 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091403 Sep 24 14:28:27.888614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 136/278] 10.222.0.52 () {58 vars in 1134 bytes} [Sat Sep 24 14:28:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:27.903212 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c7f2e13f-d59e-4aac-94b8-2ff95d2d5865 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222ac15790>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:27.988927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c7f2e13f-d59e-4aac-94b8-2ff95d2d5865 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089624 Sep 24 14:28:27.989493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 143/279] 10.222.0.52 () {58 vars in 1149 bytes} [Sat Sep 24 14:28:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:28:28.003255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dd9ff4e3-741b-4df5-b968-c512d61b31ab tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222abbd0d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:28.093629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dd9ff4e3-741b-4df5-b968-c512d61b31ab tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093961 Sep 24 14:28:28.094303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 137/280] 10.222.0.52 () {58 vars in 1134 bytes} [Sat Sep 24 14:28:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:28.109010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3068727e-6a53-4612-af7b-7b8ee30c62a4 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222abba4c0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:28.195572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3068727e-6a53-4612-af7b-7b8ee30c62a4 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090253 Sep 24 14:28:28.196453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 144/281] 10.222.0.52 () {58 vars in 1167 bytes} [Sat Sep 24 14:28:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:28:28.196593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:28.197156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:28.203803 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:28.204621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:28.204804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:28.205959 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:28.206495 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:28.207114 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:28.212026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1005f17e-f893-41bf-94d8-241819b656db tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222ac6bc10>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:28.301757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1005f17e-f893-41bf-94d8-241819b656db tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.094899 Sep 24 14:28:28.302389 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 145/282] 10.222.0.52 () {58 vars in 1170 bytes} [Sat Sep 24 14:28:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:28:28.316188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-20e63090-86bc-4431-9117-f66c0254d603 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222abba3a0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:28.363043 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:28.382454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-43a7e9c5-380a-414e-93ae-7288346bb631 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.190221 Sep 24 14:28:28.398508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 138/283] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:28 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:28:28.409482 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-20e63090-86bc-4431-9117-f66c0254d603 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097083 Sep 24 14:28:28.410043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 146/284] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 14:28:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:28:28.423468 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-34ce7521-1a16-4ec4-a4d4-133ddb258e67 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222abbd4c0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:28.503809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-34ce7521-1a16-4ec4-a4d4-133ddb258e67 tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084086 Sep 24 14:28:28.504374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 139/285] 10.222.0.52 () {58 vars in 1188 bytes} [Sat Sep 24 14:28:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:28:28.518853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-217b62e4-1585-40a2-8083-ac389a02534c tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] Calling method '.version_select at 0x7f222abce5e0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:28.604551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-217b62e4-1585-40a2-8083-ac389a02534c tempest-VolumesTestJSON-1733303842 tempest-VolumesTestJSON-1733303842-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089334 Sep 24 14:28:28.605337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 147/286] 10.222.0.52 () {58 vars in 1155 bytes} [Sat Sep 24 14:28:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:29.406189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:29.406792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:29.412995 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:29.413471 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:29.413894 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:29.414564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:29.415033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:29.415449 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:29.542944 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:29.550595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a98e0132-4806-4855-82e4-70ce86a1b674 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.148337 Sep 24 14:28:29.551232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 140/287] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:29 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:30.573944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:30.574552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:30.580760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:30.581332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:30.581765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:30.582445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:30.582921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:30.583340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:30.718837 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:30.726514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-07939df3-29a3-4d38-a5c7-e425c07d267f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.156898 Sep 24 14:28:30.727108 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 148/288] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:30 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:31.749057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:31.749828 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:31.755739 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:31.756218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:31.756647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:31.757331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:31.757779 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:31.758197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:31.891566 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:31.899599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ea3313d1-b8ef-488d-bb06-986c6afce95b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.154451 Sep 24 14:28:31.900696 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 141/289] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:31 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:32.925265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:32.925870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:32.933147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:32.933629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:32.934067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:32.934744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:32.935220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:32.935639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:33.065984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:33.073569 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5e36a896-0043-4189-96b8-6aa6b5391a38 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1521 microversion: 2.1 time: 0.152271 Sep 24 14:28:33.074130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 149/290] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:32 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:34.096292 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:34.096930 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:34.103065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:34.103548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:34.103982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:34.104664 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:34.105119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:34.105541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:34.237851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:34.245856 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-39b75d98-5155-47fc-8072-fc86ab3e9369 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1501 microversion: 2.1 time: 0.153863 Sep 24 14:28:34.246413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 142/291] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:34 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:34.269287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:34.269944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:34.276117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:34.276597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:34.277029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:34.277699 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:34.278143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:34.278568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:34.411332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:34.419523 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a1624b24-d26f-474d-ad5c-f7e0317fcc55 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1514 microversion: 2.1 time: 0.153962 Sep 24 14:28:34.420081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 150/292] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:34 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:45.315050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:28:45.317282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:45.334470 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=15 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:45.335893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=58 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:45.338323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:45.338804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:45.339529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:45.340229 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:45.340866 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:45.341295 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:45.369124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lazy-loading 'flavor' on Instance uuid db3aab52-9469-4a21-98ba-f83382ebf7ab {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:28:45.451540 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8ae3e4fa-3f0f-42cd-b8bc-be3c9a6a3c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab/action" status: 200 len: 32 microversion: 2.1 time: 0.140545 Sep 24 14:28:45.452144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 143/293] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:28:45 2022] POST /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:28:45.462320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:45.463002 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:45.465552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=15 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:45.466387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=42 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:45.471966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:45.472454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:45.472891 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:45.473592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:45.474045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:45.474552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:45.704502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:45.712900 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5eaf7ee3-a4b1-4770-a17f-ba561d75dcbe tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.254942 Sep 24 14:28:45.713466 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 151/294] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:45 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:46.737905 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:46.738519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:46.744803 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:46.745284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:46.745715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:46.746396 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:46.746867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:46.747291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:46.876943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:46.884644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ebd7b8af-8993-40be-8b46-e3b4b50c1d1e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.151069 Sep 24 14:28:46.885198 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 144/295] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:46 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:47.908610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:47.909359 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:47.917024 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:47.917506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:47.917974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:47.918844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:47.919386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:47.919877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:48.058599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:48.066807 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b5209a43-e73c-4e82-aed1-8846be91729b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.162852 Sep 24 14:28:48.067459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 152/296] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:47 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:49.089983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:49.090671 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:49.096849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:49.097258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:49.105135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:49.105135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:49.105135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:49.105135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:49.229154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:49.236727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-262994e2-0832-4b34-a632-5dd0b4e402d6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.151182 Sep 24 14:28:49.237293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 145/297] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:49 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:50.263110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:50.263709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:50.269945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:50.270437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:50.270868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:50.271538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:50.271980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:50.273009 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:50.396731 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:50.405137 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-62ddef14-591f-4d0e-a3b9-f71d4a198601 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.145878 Sep 24 14:28:50.405695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 153/298] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:50 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:51.430342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:51.430976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:51.436694 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:51.437380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:51.438075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:51.438945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:51.439494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:51.439945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:51.574837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:51.582390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-31e72dcb-e036-4085-839b-d1f6ea1aae14 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.157557 Sep 24 14:28:51.583179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 146/299] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:51 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:51.751073 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf686bf1-c497-4aa6-8773-e4ed256be3ed", "device": "/dev/sdb"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:28:51.755384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:51.765882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:51.766366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:51.767030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:51.767738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:51.768439 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:51.768868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:52.106973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8328e83d-74d6-4967-a4fe-1664da8ce73a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "POST /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359730 Sep 24 14:28:52.107826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 154/300] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:28:51 2022] POST /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:28:52.607998 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:52.609258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:52.619915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:52.620773 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:52.621178 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:52.621937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:52.622554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:52.623065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:52.802013 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:52.810146 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-25e38ce0-dbe7-4798-a926-1371661d3b7e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.207396 Sep 24 14:28:52.820213 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 147/301] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:52 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:53.843794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:53.844642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:53.851446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:53.852181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:53.852684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:53.853447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:53.853969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:53.854578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:53.990445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:53.998725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-27365a90-4d41-4dc3-bbb7-0a67821ef9c6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.159408 Sep 24 14:28:53.999366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 155/302] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:53 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:55.021736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:55.022484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:55.028814 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:55.029432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:55.029860 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:55.030586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:55.031077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:55.031494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:55.166848 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:55.174619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cb1463cc-9ca0-48cd-89da-f93cdf4a2cd6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.157116 Sep 24 14:28:55.175434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 148/303] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:55 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:56.198147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:56.198756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:56.205097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:56.205609 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:56.206046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:56.206731 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:56.207287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:56.207717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:56.345552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:56.353876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2cfbe307-4b1a-4537-8265-a48ee708e09e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.160080 Sep 24 14:28:56.354538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 156/304] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:56 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:28:57.379377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:57.379913 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:57.387174 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:57.387655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:57.388096 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:57.388767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:57.389213 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:57.389626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:57.548859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:57.557563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2a5e1e52-6618-44de-92e6-b232138782f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.183622 Sep 24 14:28:57.558129 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 149/305] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:57 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:58.581416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:58.582023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:58.588360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:58.588841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:58.589284 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:58.589957 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:58.590398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:58.590839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:58.783303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:28:58.791592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-22827c54-dcf6-4605-8479-3e98520d0c8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.214103 Sep 24 14:28:58.792229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 157/306] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:58 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:28:59.815258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:28:59.819881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:28:59.829689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:59.830172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:59.830993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:28:59.831909 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:28:59.832298 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:28:59.832942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:00.041551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:00.051602 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4120be08-bc1b-48b7-a196-7689d6a6c117 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.240766 Sep 24 14:29:00.054853 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 150/307] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:28:59 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:01.075484 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:01.076093 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:01.082722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:01.083254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:01.083680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:01.084876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:01.085330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:01.085752 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:01.303130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:01.311234 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a461ef32-ddb7-4a0b-afb0-f14beee21c17 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.239848 Sep 24 14:29:01.311808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 158/308] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:01 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:02.333155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:02.333896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:02.339946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:02.340419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:02.340847 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:02.341553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:02.341996 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:02.342414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:02.469126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:02.477390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-37259e87-4a2b-468c-9e08-c313b7d5db8c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.148011 Sep 24 14:29:02.478127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 151/309] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:02 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:03.501305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:03.501906 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:03.508547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:03.509022 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:03.509449 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:03.510122 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:03.511191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:03.511534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:03.636009 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:03.643467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-168eb7e4-1b32-42a0-8b35-fe1bd13cc382 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.147014 Sep 24 14:29:03.644014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 159/310] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:03 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:04.665597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:04.666211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:04.672185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:04.672669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:04.673104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:04.673784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:04.674232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:04.674653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:04.799194 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:04.807325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6235dc0f-4feb-4718-b0a5-afda7e61085b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.145760 Sep 24 14:29:04.807878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 152/311] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:04 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:05.829319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:05.829971 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:05.836232 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:05.836712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:05.837143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:05.837824 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:05.838273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:05.838690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:05.960889 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:05.968407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-dade6bd0-53c3-4882-a957-271e93d2af80 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.142923 Sep 24 14:29:05.968982 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 160/312] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:05 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:06.992156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:06.992773 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:06.998650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:06.999203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:06.999635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.000312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:07.000760 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:07.001179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.148226 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:07.159897 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a0010122-c779-4259-9e1f-f83a4eb791b5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1500 microversion: 2.1 time: 0.171602 Sep 24 14:29:07.160827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 153/313] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:06 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:07.192998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03caf19a-5824-45ea-a063-7eebeec36fd9"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:29:07.195873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:07.202146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:07.202628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:07.203095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.203781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:07.204229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:07.204653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.228661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] HTTP exception thrown: Cannot 'attach_volume' instance db3aab52-9469-4a21-98ba-f83382ebf7ab while it is in vm_state rescued Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Request method failure captured: Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: POST /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab/os-volume_attachments HTTP/1.1 Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 74 Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOLWriOc_fWjMg7Oul8BIvVGCEPFVpXgNIV-7u-wMLixvbrHb_bUysnihGjDt4CFF3vG1rqnqpmblstNQee2vVipwt8X8vMiHZG-diq5X4BiTl8z6Fdl-03MaNfIp0c17eGbTPzRVyT4q6mLcE4jSkRUMGjQzKf5Yisq2smRy8uLOo Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:29:07.230315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b458789f89a441caad76e78167bc00b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b458789f89a441caad76e78167bc00b"}]}] Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: c3cf8e31062d4bd7bfa76c09e7e2adea Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {"volumeAttachment": {"volumeId": "03caf19a-5824-45ea-a063-7eebeec36fd9"}} Sep 24 14:29:07.231868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Cannot 'attach_volume' instance db3aab52-9469-4a21-98ba-f83382ebf7ab while it is in vm_state rescued Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'server_id': 'db3aab52-9469-4a21-98ba-f83382ebf7ab', 'body': {'volumeAttachment': {'volumeId': '03caf19a-5824-45ea-a063-7eebeec36fd9'}}} Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance db3aab52-9469-4a21-98ba-f83382ebf7ab in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:29:07.232665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance db3aab52-9469-4a21-98ba-f83382ebf7ab while it is in vm_state rescued Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:29:07.234032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:29:07.235360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:29:07.235360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:29:07.235360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance db3aab52-9469-4a21-98ba-f83382ebf7ab while it is in vm_state rescued Sep 24 14:29:07.235360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:07.235360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Returning 409 to user: Cannot 'attach_volume' instance db3aab52-9469-4a21-98ba-f83382ebf7ab while it is in vm_state rescued {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:29:07.235360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7db1c0f1-7c58-47b6-9fcc-9a974df8f031 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042783 Sep 24 14:29:07.235360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 161/314] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:29:07 2022] POST /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 14:29:07.241017 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:29:07.241548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:07.247445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:07.247928 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:07.248360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.249036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:07.249484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:07.249902 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.313495 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-646d7f4f-d905-44e7-8cf2-53d7dfc554a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab/action" status: 202 len: 0 microversion: 2.1 time: 0.076298 Sep 24 14:29:07.314309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 154/315] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:29:07 2022] POST /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:29:07.323069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:07.323675 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:07.329551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:07.330035 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:07.330489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.331196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:07.331647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:07.332065 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:07.552028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:07.559919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4bfd7ccb-a090-4340-8a05-fe032d77db4d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.240697 Sep 24 14:29:07.560567 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 162/316] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:07 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:08.584404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:08.585139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:08.591171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:08.591649 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:08.592080 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:08.592753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:08.593197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:08.593785 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:08.721680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:08.729653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b05dcc2f-8359-4ec8-a1b7-874346d3bb88 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.149492 Sep 24 14:29:08.730387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 155/317] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:08 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:09.753301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:09.753907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:09.760622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:09.761103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:09.761530 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:09.762209 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:09.762658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:09.763105 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:10.030519 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:10.038310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b72a3b80-25fc-4abc-b425-bfdfe47c0f2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.288798 Sep 24 14:29:10.038898 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 163/318] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:09 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:11.061461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:11.062105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:11.068611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:11.069097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:11.069533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:11.070215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:11.070669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:11.071125 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:11.089753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:11.201878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:11.210160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ee7fd6d8-9f8a-4feb-8e59-faf35c907549 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.152439 Sep 24 14:29:11.210646 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 156/319] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:11 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:12.232983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:12.233510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:12.239793 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:12.240757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:12.241180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:12.241850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:12.242295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:12.242706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:12.365926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:12.373374 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7a91699a-40fb-41e5-aeaa-b23053a96f9f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.144297 Sep 24 14:29:12.373922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 164/320] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:12 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:13.396623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:13.397227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:13.403108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:13.403583 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:13.404009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:13.404681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:13.405126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:13.405543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:13.532250 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:13.540296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d327d45a-c643-42f6-8718-0ea73d4eab28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.147542 Sep 24 14:29:13.540851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 157/321] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:13 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:14.568612 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:14.569815 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:14.578156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:14.578645 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:14.579109 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:14.579803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:14.580254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:14.580673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:14.732602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:14.740649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-26f58279-6bf5-4291-bef1-401f5c4343c1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.176013 Sep 24 14:29:14.741253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 165/322] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:14 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:15.764867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:15.765464 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:15.767325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=31 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:15.772287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:15.772754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:15.773209 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:15.773877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:15.774316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:15.774727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:15.912271 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:15.919965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4394171f-28ee-4b4d-8089-64e547c161f2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.158890 Sep 24 14:29:15.920520 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 158/323] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:15 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:16.944999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:16.945582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:16.948032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=31 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:16.953356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:16.953830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:16.954259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:16.954964 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:16.955410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:16.955822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:16.958533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:17.084297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:17.092585 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f6fa70ed-2e41-4240-b464-33bf8da2ec6c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.152132 Sep 24 14:29:17.093121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 166/324] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:16 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:18.115302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:18.115909 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:18.121790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:18.122272 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:18.122701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:18.123406 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:18.123858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:18.124281 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:18.249383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:18.257028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9527789e-538e-4ad2-8ca4-e897ffd1030d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.145521 Sep 24 14:29:18.257577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 159/325] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:18 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:19.280594 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:19.281204 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:19.288223 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:19.288699 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:19.289125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:19.289797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:19.290245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:19.290661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:19.628057 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:19.635796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3fc4834d-a15f-47e4-b979-8595cbfc12bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.359035 Sep 24 14:29:19.636459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 167/326] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:19 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:20.659673 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:20.660280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:20.666413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:20.666922 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:20.667375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:20.668055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:20.668508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:20.668927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:20.793740 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:20.801246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-68ed2b71-b2dc-40e9-a8a0-771c99ce3ae6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.145787 Sep 24 14:29:20.801798 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 160/327] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:20 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:21.824870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:21.825481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:21.831874 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:21.832361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:21.832800 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:21.834120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:21.834574 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:21.835028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:21.960062 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:21.967736 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e931337e-b918-4bbf-8b28-c31211e4ed42 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.146680 Sep 24 14:29:21.968294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 168/328] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:21 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:22.990604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:22.991243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:22.997412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:22.997896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:22.998328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:22.999041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:22.999492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:22.999909 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:23.126915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:23.134920 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da449b8d-3442-466d-be87-81cada58c478 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.148103 Sep 24 14:29:23.135471 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 161/329] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:22 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:24.158831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:24.159450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:24.165735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:24.166208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:24.166635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:24.167336 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:24.167784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:24.168201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:24.316748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:24.324893 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d4c0b675-3518-4a80-b2d7-647a0c7483a2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1508 microversion: 2.1 time: 0.170081 Sep 24 14:29:24.325447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 169/330] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:24 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:25.348343 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:25.348944 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:25.354780 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:25.355286 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:25.355713 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:25.356416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:25.356873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:25.357591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:25.488057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:25.496998 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e953233b-5c4d-4c4a-ad5e-345919afdea1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1514 microversion: 2.1 time: 0.152161 Sep 24 14:29:25.503166 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 162/331] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:25 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:32.117840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7b86c86c-afe9-4a86-ad93-830499bdf2f0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'create', calling method: .version_select at 0x7f222ad11670>, body: {"keypair": {"name": "tempest-keypair-915055095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwwAJhAi4/uZLKpXNvdwwmUngUgzKCGITbP85/VNMPq2SKfJzQSHdcGml3QFgn42IK7SMsRPuOoQas5IB34KPoRURhbRSS9SDq2wRBUqbhsNNUfg4c4SBeQyOfvfZ5Fng=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:29:32.133785 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-7b86c86c-afe9-4a86-ad93-830499bdf2f0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for project 9b458789f89a441caad76e78167bc00b. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:29:32.137539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-7b86c86c-afe9-4a86-ad93-830499bdf2f0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for user c3cf8e31062d4bd7bfa76c09e7e2adea and project 9b458789f89a441caad76e78167bc00b. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:29:32.149787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b86c86c-afe9-4a86-ad93-830499bdf2f0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [b257d07b-7914-4dad-bf50-fec5c0ae2a62] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 14:29:33.157287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b86c86c-afe9-4a86-ad93-830499bdf2f0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [b257d07b-7914-4dad-bf50-fec5c0ae2a62] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50336. Sep 24 14:29:33.171629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7b86c86c-afe9-4a86-ad93-830499bdf2f0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.057705 Sep 24 14:29:33.177303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 170/332] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:29:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:29:33.445770 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:33.446250 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:33.457307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:33.458339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:33.458974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:33.459690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:33.460127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:33.460724 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:33.590232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lazy-loading 'services' on Instance uuid 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:29:33.858883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-76c444a9-5dd8-4c51-8898-c54e1fdd5ac9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952/os-volume_attachments/bf686bf1-c497-4aa6-8773-e4ed256be3ed" status: 202 len: 0 microversion: 2.1 time: 0.417056 Sep 24 14:29:33.859623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 163/333] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:29:33 2022] DELETE /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952/os-volume_attachments/bf686bf1-c497-4aa6-8773-e4ed256be3ed => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 14:29:34.710798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=23 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:34.715619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1301477684", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24a47d24-f7df-4dec-9596-133c854781ec"}], "security_groups": [{"name": "tempest-securitygroup--412748815"}], "key_name": "tempest-keypair-915055095", "user_data": "}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:29:34.815630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] validate_networks() for [('24a47d24-f7df-4dec-9596-133c854781ec', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:29:35.073361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:35.074492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:35.085635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:35.086608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:35.090156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:35.091222 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:35.091841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:35.092555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:35.130513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:29:35.250708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f5968ffe-e603-4c7c-a710-786f17369f11 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 204 len: 0 microversion: 2.1 time: 0.183568 Sep 24 14:29:35.251351 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 164/334] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:29:35 2022] DELETE /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:29:35.261369 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:35.262075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:35.267440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:29:35.268021 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:35.268214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:29:35.268506 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:35.268939 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:35.269335 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:29:35.269624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:35.270612 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:29:35.270732 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:35.271109 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:35.271692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:29:35.281972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:35.282627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:35.283350 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:35.284224 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:35.285474 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:35.286018 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:35.305258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for project 9b458789f89a441caad76e78167bc00b. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:29:35.311629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Getting quotas for user c3cf8e31062d4bd7bfa76c09e7e2adea and project 9b458789f89a441caad76e78167bc00b. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:29:35.328329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:29:35.330703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:29:35.394653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8433aa3c-dd4c-49a1-93eb-87bdf01ba3ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.684973 Sep 24 14:29:35.398909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 171/335] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:29:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:29:35.412033 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6f70b95b-4795-4c0c-bacd-4fb0d4082e30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:35.412811 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6f70b95b-4795-4c0c-bacd-4fb0d4082e30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:35.440275 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:35.449283 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4ee81dd7-4c4f-4862-9e36-014c61b51c8e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1513 microversion: 2.1 time: 0.192746 Sep 24 14:29:35.449853 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 165/336] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:35 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:29:35.488476 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6f70b95b-4795-4c0c-bacd-4fb0d4082e30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:35.497942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6f70b95b-4795-4c0c-bacd-4fb0d4082e30 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1245 microversion: 2.1 time: 0.093736 Sep 24 14:29:35.498501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 172/337] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:35 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:29:36.476268 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:36.477717 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:36.486025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:36.487098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:36.488629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:36.491172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:36.492743 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:36.493647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:36.523607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2398fe89-5da3-4c98-8c05-a5411f2f50ff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:36.524448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2398fe89-5da3-4c98-8c05-a5411f2f50ff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:36.581419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2398fe89-5da3-4c98-8c05-a5411f2f50ff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:36.589815 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2398fe89-5da3-4c98-8c05-a5411f2f50ff tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1245 microversion: 2.1 time: 0.072837 Sep 24 14:29:36.590508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 173/338] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:36 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:29:36.659683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:36.668632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-714f46be-5e08-4bbb-826d-e78f1fd70383 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1513 microversion: 2.1 time: 0.198936 Sep 24 14:29:36.669235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 166/339] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:36 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:37.613059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4af079a9-3c63-417a-b2bf-af25356f08bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:37.614281 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4af079a9-3c63-417a-b2bf-af25356f08bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:37.682220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4af079a9-3c63-417a-b2bf-af25356f08bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:37.690769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4af079a9-3c63-417a-b2bf-af25356f08bd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1245 microversion: 2.1 time: 0.081976 Sep 24 14:29:37.695437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:37.696261 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:37.703638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 174/340] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:37 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:37.703903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:37.704661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:37.706062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:37.707141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:37.708420 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:37.709027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:37.851243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:37.858761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-27b49132-083f-458b-9461-63c8b0294d16 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1513 microversion: 2.1 time: 0.168206 Sep 24 14:29:37.859346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 167/341] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:37 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:29:38.608477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-69919e51-4ed2-4c61-8925-a01c1ec7d70d req-cbde0ceb-5018-4199-93bd-4fb6c7910d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952", "name": "network-vif-deleted", "tag": "6536c4db-7f73-4444-affe-19257ef170a5"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:29:38.618686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-69919e51-4ed2-4c61-8925-a01c1ec7d70d req-cbde0ceb-5018-4199-93bd-4fb6c7910d79 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:38.619364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-69919e51-4ed2-4c61-8925-a01c1ec7d70d req-cbde0ceb-5018-4199-93bd-4fb6c7910d79 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:38.619766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-69919e51-4ed2-4c61-8925-a01c1ec7d70d req-cbde0ceb-5018-4199-93bd-4fb6c7910d79 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:38.631620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-69919e51-4ed2-4c61-8925-a01c1ec7d70d req-cbde0ceb-5018-4199-93bd-4fb6c7910d79 service nova] Creating event network-vif-deleted:6536c4db-7f73-4444-affe-19257ef170a5 for instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 on hv-cinder-85919 Sep 24 14:29:38.636548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-69919e51-4ed2-4c61-8925-a01c1ec7d70d req-cbde0ceb-5018-4199-93bd-4fb6c7910d79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Sep 24 14:29:38.637119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 175/342] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:29:38.715570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-98996a05-8607-4be1-b825-bc96ec73b89f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:38.716183 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-98996a05-8607-4be1-b825-bc96ec73b89f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:38.767159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-98996a05-8607-4be1-b825-bc96ec73b89f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:38.774876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-98996a05-8607-4be1-b825-bc96ec73b89f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1245 microversion: 2.1 time: 0.062797 Sep 24 14:29:38.775549 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 168/343] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:38 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1245 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:38.882780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:38.883662 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:38.890591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:38.890994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:38.891412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:38.892043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:38.892490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:38.892903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:38.954012 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:38.961532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fe401b64-8ee5-4ad2-b123-70dc49170ea8 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1471 microversion: 2.1 time: 0.083592 Sep 24 14:29:38.962087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 176/344] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:38 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:39.798779 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:39.799398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:39.805172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:39.805645 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:39.806073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:39.806740 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:39.807208 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:39.807622 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:39.871193 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:39.880429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-abe0ad95-cb83-477e-b64f-11ae626f2d0e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1249 microversion: 2.1 time: 0.085496 Sep 24 14:29:39.880978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 169/345] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:39 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:39.984949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:39.985557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:39.992337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:39.992820 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:39.993252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:39.993935 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:39.994387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:39.994804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:40.054115 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:40.061638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f9c85fbf-965d-4466-8d8d-51dd841769b7 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1471 microversion: 2.1 time: 0.080574 Sep 24 14:29:40.062192 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 177/346] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:39 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1471 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:40.903346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:40.903954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:40.910161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:40.911289 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:40.911726 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:40.912413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:40.912866 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:40.913288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:40.973952 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:40.981536 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cb60d97f-5078-4b2f-b74d-1ee6a23ac3a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1249 microversion: 2.1 time: 0.082097 Sep 24 14:29:40.982093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 170/347] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:40 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:41.084908 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:41.085474 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:41.091746 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:41.092221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:41.092646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:41.093317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:41.093763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:41.094179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:41.156493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:41.164152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9bd2b64d-c06a-4796-bbd0-22a6399b26be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1303 microversion: 2.1 time: 0.083776 Sep 24 14:29:41.164703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 178/348] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:41 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:42.004062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:42.005449 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:42.011498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:42.012037 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:42.012669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:42.013421 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:42.013916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:42.014345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:42.017492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:42.083175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:42.091559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c3a88cad-f846-41b3-b767-f04c434adef3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1249 microversion: 2.1 time: 0.091385 Sep 24 14:29:42.092101 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 171/349] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:41 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:42.189444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:42.190837 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:42.198924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:42.199596 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:42.200391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:42.201656 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:42.202291 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:42.203154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:42.240778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:42.240928 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:42.241358 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:42.241798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lazy-loading 'fault' on Instance uuid 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:29:42.283364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:42.291645 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7f6baf22-142b-4cc2-adfe-fdb11f2425df tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 200 len: 1308 microversion: 2.1 time: 0.108671 Sep 24 14:29:42.292202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 179/350] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:42 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:43.118325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:43.120257 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:43.132257 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:43.133634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:43.134384 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:43.135836 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:43.136918 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:43.137508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:43.262976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:43.275908 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-62be4dc8-e2aa-41ef-8905-78889a3a250a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1297 microversion: 2.1 time: 0.163560 Sep 24 14:29:43.276824 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 172/351] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:43 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1297 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:43.315507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:43.317235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:43.328779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:43.329277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:43.330608 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:43.331361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:43.331822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:43.336794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:43.363967 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] HTTP exception thrown: Instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 could not be found. Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Request method failure captured: Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 HTTP/1.1 Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxPXPzE-gXasBH8LB12b9Uzp2pFHW62ylGOVzrcUFHvpjB9a1n5G_9Fs1d4tHH-yFi6VeNF100vu9OggoYDxcR0kh5TUkqqQmL0zpiION145SbL6w5h30E-C18rNg9VxaSAl7uSg9MwTlS8cq3Qagx0ZWVa12eD8RXz8lY6JLqu4O84 Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 27e584f45faa47afa4ced9db997f4e4a Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesSnapshotTestJSON-913420090 Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:29:43.366258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/27e584f45faa47afa4ced9db997f4e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_27e584f45faa47afa4ced9db997f4e4a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/27e584f45faa47afa4ced9db997f4e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/27e584f45faa47afa4ced9db997f4e4a"}]}] Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesSnapshotTestJSON-913420090 Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 27e584f45faa47afa4ced9db997f4e4a Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-913420090 Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesSnapshotTestJSON-913420090-project Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: d381a365e0744834b716fa6b0ea18d3d Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesSnapshotTestJSON-913420090-project Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 could not be found. Sep 24 14:29:43.367821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952'} Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 could not be found. Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:29:43.368924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 could not be found. Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 could not be found. Sep 24 14:29:43.370400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:29:43.384946 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Returning 404 to user: Instance 4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:29:43.386094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fd79df92-1e50-4829-a61c-b57f1f2bcf46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952" status: 404 len: 111 microversion: 2.1 time: 0.075414 Sep 24 14:29:43.387070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 180/352] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:43 2022] GET /compute/v2.1/servers/4ad5f39a-1ad3-4e1d-8d99-0f2cbdc66952 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:29:44.314398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:44.315039 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:44.317587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 14:29:44.317737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Sat Sep 24 14:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 (ip 10.222.0.52) !!! Sep 24 14:29:44.323609 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:44.324097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:44.324539 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:44.325228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:44.325681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:44.326105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:44.466391 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:44.482202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0ae47ae1-4c7a-48e4-810e-9b4bca9126f4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.171740 Sep 24 14:29:44.483329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 173/353] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:44 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:44.856178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-de0d0021-cd45-4ade-8af8-32105b2bd58c req-e637ebc7-4eb9-4b4e-abbc-a1d62b23eb23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c64d080-3e58-4d1a-a7cc-a2406fc39ce9", "tag": "1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:29:44.865994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-de0d0021-cd45-4ade-8af8-32105b2bd58c req-e637ebc7-4eb9-4b4e-abbc-a1d62b23eb23 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:44.866607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-de0d0021-cd45-4ade-8af8-32105b2bd58c req-e637ebc7-4eb9-4b4e-abbc-a1d62b23eb23 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:44.867075 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-de0d0021-cd45-4ade-8af8-32105b2bd58c req-e637ebc7-4eb9-4b4e-abbc-a1d62b23eb23 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:44.877642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-de0d0021-cd45-4ade-8af8-32105b2bd58c req-e637ebc7-4eb9-4b4e-abbc-a1d62b23eb23 service nova] Creating event network-changed:1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b for instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 on hv-cinder-85919 Sep 24 14:29:44.883056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-de0d0021-cd45-4ade-8af8-32105b2bd58c req-e637ebc7-4eb9-4b4e-abbc-a1d62b23eb23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030538 Sep 24 14:29:44.883624 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 181/354] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:29:45.505926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:45.506532 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:45.512763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:45.513241 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:45.513669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:45.514343 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:45.514788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:45.515227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:45.639681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:45.647584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9d9f09d7-4c29-4752-ab88-ef20aa683217 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.146151 Sep 24 14:29:45.648140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 174/355] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:45 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:46.668123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:46.672940 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:46.673638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:46.681564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:46.682348 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:46.682794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:46.683513 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:46.683969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:46.684399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:46.818730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:46.826333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4d638c6f-ddf9-4d51-a7eb-0e230bfbda2e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.159213 Sep 24 14:29:46.826913 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 182/356] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:46 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:47.849963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:47.850589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:47.852463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:47.857632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:47.858117 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:47.858548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:47.859258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:47.859706 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:47.860127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:47.984964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:47.993201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-efa4da98-0fc3-4e3d-a7bf-26910246bdb1 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.147675 Sep 24 14:29:47.993824 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 175/357] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:47 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:49.016119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:49.016639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:49.018933 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=16 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:49.020123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:49.026179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:49.026666 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:49.027132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:49.027816 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:49.028271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:49.028697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:49.154876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:49.164363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6d405f0f-67c8-48c3-aa49-0fc8c7ed80a8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.152197 Sep 24 14:29:49.164921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 183/358] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:49 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:50.186586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:50.187234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:50.190145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:50.195446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:50.195926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:50.196357 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:50.197045 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:50.197487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:50.197899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:50.338540 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:50.347699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-47ba78e4-91d3-4e44-9b0f-4786417363f8 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.164799 Sep 24 14:29:50.348799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 176/359] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:50 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:51.372109 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:51.372632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:51.378895 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:51.379376 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:51.379812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:51.380483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:51.380932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:51.381352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:51.508786 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:51.516370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-232c9087-ffb5-4618-9d9a-ce47ae51f26a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.148160 Sep 24 14:29:51.516919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 184/360] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:51 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:52.540776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:52.541308 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:52.547440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:52.547932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:52.548367 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:52.549078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:52.549553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:52.549996 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:52.678242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:52.685907 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8eef2eb1-101d-4a54-b60d-f88d17f3863d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.149954 Sep 24 14:29:52.686555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 177/361] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:52 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:53.709422 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:53.710411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:53.717553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:53.718035 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:53.718467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:53.719622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:53.720433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:53.721133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:53.856911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:53.866056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5b3b30cc-d403-4623-9860-bb76d0f1e808 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.161210 Sep 24 14:29:53.866621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 185/362] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:53 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:54.888799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:54.889404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:54.896191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:54.896664 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:54.897092 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:54.897763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:54.898206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:54.898621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:55.025949 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:55.033853 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7220881e-7b5a-4a57-bba5-f5c18af01b28 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.148899 Sep 24 14:29:55.034410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 178/363] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:54 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:56.055668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:56.056304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:56.067287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:56.067287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:56.067287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:56.067287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:56.067741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:56.067741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:56.202046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:56.210381 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-98b1dddc-46f3-423f-a505-5468f039af87 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.158550 Sep 24 14:29:56.210983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 186/364] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:56 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:56.532488 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2099281850", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "networks": [{"uuid": "a32ad358-eeec-447f-91f8-a6f31db4b6a2"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:29:56.585812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] validate_networks() for [('a32ad358-eeec-447f-91f8-a6f31db4b6a2', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:29:56.950658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:29:56.951113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:29:56.951589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:29:56.952001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:29:56.952412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:29:56.964783 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:56.965202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:56.965670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:56.966400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:56.967381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:56.967819 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:57.002004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Getting quotas for project 27e584f45faa47afa4ced9db997f4e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:29:57.007783 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Getting quotas for user d381a365e0744834b716fa6b0ea18d3d and project 27e584f45faa47afa4ced9db997f4e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:29:57.022621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:29:57.025432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:29:57.074566 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1ab6c51e-4a5e-498f-b22f-f661c257b49c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546394 Sep 24 14:29:57.075405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 179/365] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:29:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 14:29:57.086292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-39c82a24-ccbb-4e84-bdc8-6779747639d9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:57.087015 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-39c82a24-ccbb-4e84-bdc8-6779747639d9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:57.141994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-39c82a24-ccbb-4e84-bdc8-6779747639d9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:57.149386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-39c82a24-ccbb-4e84-bdc8-6779747639d9 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1219 microversion: 2.1 time: 0.066958 Sep 24 14:29:57.149936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 187/366] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:57 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:57.233441 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:57.234051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:57.240623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:57.241105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:57.241540 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:57.242224 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:57.242675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:57.243125 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:57.375718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:57.383744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-275a0cec-aab9-41bb-8c9f-63c0e07390b2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.154155 Sep 24 14:29:57.384410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 180/367] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:57 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:58.172440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:58.173148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:58.180076 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:58.180555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:58.180981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:58.181655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:58.182098 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:58.182508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:58.258472 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:58.267188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8b05c768-1380-46a4-b94d-fe468b1c158e tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1223 microversion: 2.1 time: 0.098558 Sep 24 14:29:58.267753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 188/368] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:58 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:58.407761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:58.408371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:58.414927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:58.415405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:58.415835 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:58.416510 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:58.416960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:58.417376 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:58.546390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:58.554879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dadec362-594e-4bd1-965e-a5a67c34f66e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.151431 Sep 24 14:29:58.555469 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 181/369] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:58 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:59.291749 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:59.293019 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:59.300112 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:59.300691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:59.301225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:59.301987 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:59.302516 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:59.303043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:59.367610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:59.375501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7f0f842b-68f1-4463-ac47-6fc93e51c591 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1223 microversion: 2.1 time: 0.087441 Sep 24 14:29:59.376494 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 189/370] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:59 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:29:59.578087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:29:59.578877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:29:59.585456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:59.586048 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:59.586690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:59.587418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:29:59.587870 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:29:59.588293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:29:59.759544 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:29:59.767065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-69203d1c-4b14-4497-bba2-ec2b69225e11 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.192814 Sep 24 14:29:59.767632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 182/371] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:29:59 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:00.399030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:00.399641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:00.406165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:00.406931 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:00.407369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:00.408058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:00.408511 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:00.408936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:00.467608 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:00.474981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8d5024e5-607c-4ede-946e-721dd677bca0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1223 microversion: 2.1 time: 0.079854 Sep 24 14:30:00.475537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 190/372] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:00 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:00.795299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:00.796120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:00.805640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:00.806775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:00.807242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:00.808006 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:00.808610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:00.808989 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:00.933753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:00.941256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-397871f6-a9c8-4170-a43f-ca2b6aadf671 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.151181 Sep 24 14:30:00.941812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 183/373] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:00 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:01.497292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:01.497904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:01.504705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:01.505184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:01.505616 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:01.506301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:01.506754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:01.507205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:01.565561 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:01.573499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9205fa9f-498f-4b05-b38e-2538707b3046 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1271 microversion: 2.1 time: 0.079958 Sep 24 14:30:01.573994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 191/374] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:01 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:01.963919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:01.964533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:01.970667 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:01.971212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:01.971650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:01.972334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:01.972792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:01.973219 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:02.102749 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:02.110497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2ae2bc8e-b174-4de6-87ae-e81574bc4f7d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.151038 Sep 24 14:30:02.111088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 184/375] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:01 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:02.352668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-d107fd62-85db-42ef-b015-1cc044468913 req-17d0d18a-d803-45a2-803d-a0c1694f9fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c64d080-3e58-4d1a-a7cc-a2406fc39ce9", "name": "network-vif-plugged", "status": "completed", "tag": "1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:02.371564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d107fd62-85db-42ef-b015-1cc044468913 req-17d0d18a-d803-45a2-803d-a0c1694f9fb9 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:02.375188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d107fd62-85db-42ef-b015-1cc044468913 req-17d0d18a-d803-45a2-803d-a0c1694f9fb9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:02.375639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d107fd62-85db-42ef-b015-1cc044468913 req-17d0d18a-d803-45a2-803d-a0c1694f9fb9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:02.392904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-d107fd62-85db-42ef-b015-1cc044468913 req-17d0d18a-d803-45a2-803d-a0c1694f9fb9 service nova] Creating event network-vif-plugged:1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b for instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 on hv-cinder-85919 Sep 24 14:30:02.403969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-d107fd62-85db-42ef-b015-1cc044468913 req-17d0d18a-d803-45a2-803d-a0c1694f9fb9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055023 Sep 24 14:30:02.404756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 192/376] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:30:02.597711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:02.599505 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:02.606577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:02.607535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:02.608095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:02.609040 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:02.609565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:02.610060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:02.676995 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:02.690928 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cc4362e0-10d6-4326-8acc-04806c591546 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1277 microversion: 2.1 time: 0.097505 Sep 24 14:30:02.691851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 185/377] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:02 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:03.134785 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:03.136016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:03.146295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:03.146988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:03.147421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:03.148114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:03.148561 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:03.148974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:03.284413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1703173195", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "networks": [{"uuid": "5cde2b2a-2e0e-44db-bb33-6d4b4863e498"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:03.298931 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:03.307419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-47dd5e65-4bf2-4ce0-8723-4d0c034f3d99 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.176976 Sep 24 14:30:03.307983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 193/378] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:03 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:03.342763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] validate_networks() for [('5cde2b2a-2e0e-44db-bb33-6d4b4863e498', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:30:03.692497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:30:03.692915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:30:03.693389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:30:03.693813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:30:03.694202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:30:03.703066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:03.703572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:03.704025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:03.704740 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:03.705216 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:03.705631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:03.715043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:03.715656 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:03.721425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:03.721917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:03.722018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Getting quotas for project 5ab7af1a1c6749548a6ed520b119d868. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:30:03.722352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:03.723612 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:03.724063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:03.724489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:03.726345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Getting quotas for user e22e1db5255c4ac0903d94a382069db6 and project 5ab7af1a1c6749548a6ed520b119d868. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:30:03.737022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:30:03.739767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:30:03.742512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:03.784979 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ef97c14b-46a4-4966-9e3c-75b2f516acf5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504522 Sep 24 14:30:03.786766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 186/379] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:30:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 14:30:03.797863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cff250e3-716f-4a36-a587-9a44f59ec959 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:03.798465 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cff250e3-716f-4a36-a587-9a44f59ec959 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:03.864017 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cff250e3-716f-4a36-a587-9a44f59ec959 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:03.874953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cff250e3-716f-4a36-a587-9a44f59ec959 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1214 microversion: 2.1 time: 0.080730 Sep 24 14:30:03.876732 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 187/380] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:03 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:03.908553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:03.917195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-629c5cd8-ec72-4309-aecb-d3b92f51582d tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.205946 Sep 24 14:30:03.917800 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 194/381] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:03 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:30:04.331203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:04.331822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:04.339088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:04.339632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:04.340061 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:04.340826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:04.341281 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:04.341703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:04.476614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:04.484302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da027a09-6dea-4f0a-9749-e8b453552e90 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.157168 Sep 24 14:30:04.484861 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 188/382] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:04 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:04.556654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-45eb5304-7f84-410a-a112-422bb26cc9d1 req-05ed108f-45e6-4552-9a4e-00426667ca26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c44be5-8822-4ba2-b0be-4431ac14f185", "tag": "efe264bb-2645-4dc3-899c-304f3587db1e"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:04.565925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-45eb5304-7f84-410a-a112-422bb26cc9d1 req-05ed108f-45e6-4552-9a4e-00426667ca26 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:04.566963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-45eb5304-7f84-410a-a112-422bb26cc9d1 req-05ed108f-45e6-4552-9a4e-00426667ca26 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:04.567387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-45eb5304-7f84-410a-a112-422bb26cc9d1 req-05ed108f-45e6-4552-9a4e-00426667ca26 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:04.577779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-45eb5304-7f84-410a-a112-422bb26cc9d1 req-05ed108f-45e6-4552-9a4e-00426667ca26 service nova] Creating event network-changed:efe264bb-2645-4dc3-899c-304f3587db1e for instance b1c44be5-8822-4ba2-b0be-4431ac14f185 on hv-cinder-85919 Sep 24 14:30:04.584123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-45eb5304-7f84-410a-a112-422bb26cc9d1 req-05ed108f-45e6-4552-9a4e-00426667ca26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031116 Sep 24 14:30:04.584709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 195/383] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:30:04.898963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:04.899572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:04.905486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:04.905963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:04.906392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:04.907355 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:04.907799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:04.908215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:04.940646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:04.941980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:04.948049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:04.948529 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:04.948958 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:04.949637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:04.950083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:04.950757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:04.974738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:04.982908 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da6860f7-e4e5-42c8-a32b-36fe44c252ce tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1218 microversion: 2.1 time: 0.087772 Sep 24 14:30:04.983576 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 189/384] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:04 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:05.150419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:05.158399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-eb288673-d3ea-467b-9e44-a375d4d1f00c tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.221860 Sep 24 14:30:05.158993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 196/385] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:04 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:30:05.506902 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:05.507634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:05.513563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:05.514130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:05.514635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:05.515415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:05.515933 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:05.516612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:05.519870 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:05.656964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:05.665893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-edaf3908-30a7-45d0-a13c-27cfc0eff8e9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1370 microversion: 2.1 time: 0.162912 Sep 24 14:30:05.666506 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 190/386] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:05 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:06.006992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:06.008293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:06.015875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.016436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.019183 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:06.020591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.021155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.021658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:06.091716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:06.099673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-154287ab-69b9-463b-a589-5ffe7eab80a4 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1266 microversion: 2.1 time: 0.097573 Sep 24 14:30:06.100243 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 197/387] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:06 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:06.181654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:06.182265 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:06.188127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.188605 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.189037 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:06.189715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.190159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.190578 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:06.341943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:06.352152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ece20ca6-9cd5-432d-ac43-78f1779c3eca tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.173942 Sep 24 14:30:06.353195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 191/388] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:06 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:06.690174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:06.690805 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:06.697068 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.697675 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.698215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:06.698972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.699450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.699945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:06.917579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:06.925544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b7c817cf-5070-44e1-bdec-a144d5f60fc4 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1564 microversion: 2.1 time: 0.240132 Sep 24 14:30:06.926558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 198/389] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:06 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1564 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:06.949658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:06.950238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:06.955875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.956352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.957375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:06.958056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:06.958600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:06.959062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:07.037600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f4734fdd-5fcc-42ff-9347-6a1ea83e3177 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091798 Sep 24 14:30:07.038406 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 192/390] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:30:06 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:30:07.123521 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:07.124130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:07.131384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:07.131882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:07.132318 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:07.133015 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:07.133464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:07.133885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:07.149776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:07.207592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:07.216152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5df32000-776d-4037-99c8-07a099e28332 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1272 microversion: 2.1 time: 0.097548 Sep 24 14:30:07.216721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 199/391] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:07 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:07.375720 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:07.376333 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:07.383064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:07.383565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:07.384000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:07.384698 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:07.385147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:07.385567 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:07.932679 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:07.941088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-df059b68-8249-4ae5-9afe-16c42a76cdda tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.569251 Sep 24 14:30:07.942197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 193/392] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:07 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:08.240259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:08.240871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:08.247167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:08.247649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:08.248082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:08.248765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:08.249219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:08.249640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:08.385989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:08.393586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8f78ebb7-4299-499c-8d79-d189bff56a49 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.157864 Sep 24 14:30:08.394148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 200/393] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:08 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:08.460824 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-3e7f7f88-3b5d-4bed-af74-6ba40781cc9f req-174f89c2-1c39-4533-9a06-60cfe9dc2cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c64d080-3e58-4d1a-a7cc-a2406fc39ce9", "tag": "1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:08.470402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3e7f7f88-3b5d-4bed-af74-6ba40781cc9f req-174f89c2-1c39-4533-9a06-60cfe9dc2cc5 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:08.470984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3e7f7f88-3b5d-4bed-af74-6ba40781cc9f req-174f89c2-1c39-4533-9a06-60cfe9dc2cc5 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:08.471482 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3e7f7f88-3b5d-4bed-af74-6ba40781cc9f req-174f89c2-1c39-4533-9a06-60cfe9dc2cc5 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:08.483121 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-3e7f7f88-3b5d-4bed-af74-6ba40781cc9f req-174f89c2-1c39-4533-9a06-60cfe9dc2cc5 service nova] Creating event network-changed:1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b for instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 on hv-cinder-85919 Sep 24 14:30:08.488258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-3e7f7f88-3b5d-4bed-af74-6ba40781cc9f req-174f89c2-1c39-4533-9a06-60cfe9dc2cc5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031632 Sep 24 14:30:08.488965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 194/394] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:30:08.972003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:08.972899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:08.986862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:08.986862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:08.986862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:08.986862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:08.987258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:08.987258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:09.159143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:09.172387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fde62769-04cf-40de-afe2-c126487f85b0 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.207514 Sep 24 14:30:09.173377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 201/395] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:08 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:09.416489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:09.417182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:09.423303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:09.423776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:09.424205 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:09.424869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:09.426005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:09.426244 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:09.575161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:09.582915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6ce50456-2163-48e1-b55b-3c12ea2b2c1d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.170538 Sep 24 14:30:09.583419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 195/396] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:09 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:10.196208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:10.196849 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:10.203255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:10.203739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:10.204176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:10.204863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:10.205318 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:10.205745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:10.336071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:10.343650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6219c56e-2198-4627-acdd-aca844ac623a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.151488 Sep 24 14:30:10.344206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 202/397] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:10 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:10.606165 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:10.606767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:10.612689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:10.613797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:10.614227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:10.614928 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:10.615375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:10.615790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:10.745882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:10.753495 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-68aa11c2-bb1b-4b02-9eb9-7944a6a6f162 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.151136 Sep 24 14:30:10.754053 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 196/398] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:10 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:11.366794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:11.367396 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:11.373649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:11.374120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:11.374540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:11.375239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:11.375684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:11.376099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:11.509058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:11.517634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-755d9255-521c-4e03-9001-ac8d24ef1367 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.154613 Sep 24 14:30:11.518116 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 203/399] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:11 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:11.777246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:11.777858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:11.784127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:11.784611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:11.785747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:11.786444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:11.786918 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:11.787341 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:11.914947 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:11.922555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-942311f1-baad-4e8f-93a9-cdad632b2d2c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.149877 Sep 24 14:30:11.923140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 197/400] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:11 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:12.540842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:12.541441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:12.547855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:12.548273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:12.548697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:12.549367 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:12.549809 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:12.550223 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:12.679214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:12.686971 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-31e46592-0407-40d0-a467-ec89d92cb15a tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.149898 Sep 24 14:30:12.687528 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 204/401] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:12 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:12.946374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:12.947022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:12.953024 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:12.953503 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:12.953938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:12.954621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:12.955105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:12.955531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:13.082498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:13.090185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d5e8b074-7bda-4c8f-a8ae-bda997343b89 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.147670 Sep 24 14:30:13.090688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 198/402] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:12 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:13.710191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:13.710797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:13.716976 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:13.717460 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:13.717901 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:13.718580 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:13.719051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:13.719468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:13.852978 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:13.860538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-00e7508a-ec61-4775-9846-993e1a955886 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.154913 Sep 24 14:30:13.861097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 205/403] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:13 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:14.111910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:14.112542 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:14.114541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:14.115227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=14 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:14.121471 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:14.121957 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:14.122390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:14.123098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:14.123548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:14.123968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:14.252592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:14.261052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-698de6d7-ec4f-452f-913b-3a7e1fde6a41 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.153099 Sep 24 14:30:14.261614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 199/404] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:14 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:14.882642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:14.883812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:14.890088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:14.890575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:14.891035 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:14.891719 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:14.892170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:14.892631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:15.025855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:15.033745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6765f080-9ac9-43ac-b8af-f1024978d158 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.155061 Sep 24 14:30:15.034289 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 206/405] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:14 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:15.284115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:15.284734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:15.291093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:15.291569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:15.291998 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:15.292667 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:15.293110 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:15.293559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:15.428924 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:15.437052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-89c68913-8889-47eb-8de1-d937e967dd84 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.157163 Sep 24 14:30:15.437615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 200/406] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:15 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:16.056641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:16.057241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:16.063139 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:16.063614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:16.064039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:16.064714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:16.065157 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:16.065566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:16.366503 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:16.373993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2c6e00dc-2a38-4288-9542-e9102fbae987 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.321121 Sep 24 14:30:16.374546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 207/407] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:16 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:16.460564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:16.461376 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:16.467598 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:16.468093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:16.468529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:16.469227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:16.470248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:16.470979 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:16.546835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-3b8a1dd7-2731-4853-8a4e-65e44f03cbbe req-ede793cb-92ed-4527-9071-d8162fabf204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6521b9ab-7bd9-4568-bd81-d24b8f91f198", "tag": "f7e81c8b-495e-44bd-8e81-16cff8e8588d"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:16.556525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-3b8a1dd7-2731-4853-8a4e-65e44f03cbbe req-ede793cb-92ed-4527-9071-d8162fabf204 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:16.557101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-3b8a1dd7-2731-4853-8a4e-65e44f03cbbe req-ede793cb-92ed-4527-9071-d8162fabf204 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:16.557755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-3b8a1dd7-2731-4853-8a4e-65e44f03cbbe req-ede793cb-92ed-4527-9071-d8162fabf204 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:16.569734 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-3b8a1dd7-2731-4853-8a4e-65e44f03cbbe req-ede793cb-92ed-4527-9071-d8162fabf204 service nova] Creating event network-changed:f7e81c8b-495e-44bd-8e81-16cff8e8588d for instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 on hv-cinder-85919 Sep 24 14:30:16.578648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-3b8a1dd7-2731-4853-8a4e-65e44f03cbbe req-ede793cb-92ed-4527-9071-d8162fabf204 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034418 Sep 24 14:30:16.579526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 208/408] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:30:16.617069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:16.624938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e2eca347-bb00-490d-83cd-4c34653b0420 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.169058 Sep 24 14:30:16.625497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 201/409] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:16 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:17.398004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:17.398702 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:17.405549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:17.406028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:17.406743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:17.407449 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:17.407899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:17.408320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:17.536399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:17.544543 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4eb2725e-f8ac-48a0-8f0b-70dfb3156967 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.151268 Sep 24 14:30:17.545108 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 209/410] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:17 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:17.648364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:17.648907 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:17.655005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:17.655487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:17.655920 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:17.656850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:17.657300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:17.657718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:17.785270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:17.792788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a6ae5e89-7f4e-4f23-8802-e17add56ea5c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.148859 Sep 24 14:30:17.793354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 202/411] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:17 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:18.567356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:18.567964 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:18.574253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:18.574735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:18.575268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:18.575942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:18.576393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:18.576810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:18.707126 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:18.714678 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e57b2a7b-7356-4002-8ff7-fa12b215e594 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.151181 Sep 24 14:30:18.715285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 210/412] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:18 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:18.817022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:18.817715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:18.819765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:18.825040 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:18.825523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:18.825955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:18.826646 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:18.827126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:18.827550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:18.956069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:18.964119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9d697ece-be9b-4ace-847e-a0eec82d5c10 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.152453 Sep 24 14:30:18.964677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 203/413] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:18 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:19.738083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:19.738722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:19.741138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=58 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:19.746166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:19.746644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:19.747123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:19.747803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:19.748257 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:19.748678 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:19.878696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:19.886377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-153427f7-b868-4aff-8c28-8592dfd4d2fd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.152735 Sep 24 14:30:19.886958 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 211/414] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:19 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:19.987300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:19.988517 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:19.994352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:19.994868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:19.995303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:19.995975 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:19.996418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:19.996833 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:20.123433 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:20.131120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-30c37994-c2e1-4ebd-b1d1-c79534c4a372 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.147646 Sep 24 14:30:20.131675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 204/415] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:19 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:20.909107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:20.910341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:20.917151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:20.917899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:20.918592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:20.919493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:20.920257 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:20.920844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:20.941103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:21.076340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-125ad8e1-a8b5-4af2-9e0d-6d7d2876bbe3 req-2398a2f8-bfc2-4d9b-9d10-49ea938421ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c44be5-8822-4ba2-b0be-4431ac14f185", "name": "network-vif-plugged", "status": "completed", "tag": "efe264bb-2645-4dc3-899c-304f3587db1e"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:21.092735 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-125ad8e1-a8b5-4af2-9e0d-6d7d2876bbe3 req-2398a2f8-bfc2-4d9b-9d10-49ea938421ad service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:21.093967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-125ad8e1-a8b5-4af2-9e0d-6d7d2876bbe3 req-2398a2f8-bfc2-4d9b-9d10-49ea938421ad service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:21.094859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-125ad8e1-a8b5-4af2-9e0d-6d7d2876bbe3 req-2398a2f8-bfc2-4d9b-9d10-49ea938421ad service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:21.110051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-125ad8e1-a8b5-4af2-9e0d-6d7d2876bbe3 req-2398a2f8-bfc2-4d9b-9d10-49ea938421ad service nova] Creating event network-vif-plugged:efe264bb-2645-4dc3-899c-304f3587db1e for instance b1c44be5-8822-4ba2-b0be-4431ac14f185 on hv-cinder-85919 Sep 24 14:30:21.116336 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-125ad8e1-a8b5-4af2-9e0d-6d7d2876bbe3 req-2398a2f8-bfc2-4d9b-9d10-49ea938421ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045637 Sep 24 14:30:21.117112 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 205/416] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:30:21.118891 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:21.130930 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-56a38f3f-2a61-4c42-9e83-c5ee5933a22f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.222827 Sep 24 14:30:21.133127 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 212/417] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:20 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:21.154128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:21.154900 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:21.162663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:21.163100 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:21.163552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:21.164261 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:21.164715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:21.165134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:21.391330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:21.399960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-67324363-ba61-42c6-b03d-d0d059d8819a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.250011 Sep 24 14:30:21.400965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 206/418] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:21 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:22.154673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:22.155317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:22.162115 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:22.162601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:22.163063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:22.163754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:22.164211 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:22.164664 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:22.313125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:22.320792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e95be926-c5e7-4197-8f98-2f20d5239aa2 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.170207 Sep 24 14:30:22.321362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 213/419] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:22 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:22.424000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:22.424533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:22.431338 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:22.431822 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:22.432256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:22.432939 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:22.433383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:22.433797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:22.564966 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:22.572456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d2238853-a7c2-4a05-b8f1-4e166a8aee05 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.152668 Sep 24 14:30:22.573016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 207/420] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:22 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:23.343400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:23.343997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:23.350784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:23.351284 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:23.351711 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:23.352379 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:23.352822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:23.353237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:23.482854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:23.490336 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4fd4b9da-43fc-4c64-89e2-0c3beadab684 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.150761 Sep 24 14:30:23.490911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 214/421] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:23 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:23.595370 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:23.596020 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:23.602572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:23.603088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:23.603524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:23.604206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:23.604655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:23.605074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:23.619641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:23.729719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:23.737262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a428ed47-6fdf-4401-918a-8e8d6f453615 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.145789 Sep 24 14:30:23.737813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 208/422] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:23 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:24.512848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:24.513456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:24.519756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:24.520235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:24.520666 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:24.521343 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:24.521791 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:24.522209 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:24.651537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:24.659980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0feb8e53-9a1a-4671-a68f-459c6b19b5bd tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.150370 Sep 24 14:30:24.660548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 215/423] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:24 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:24.759629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:24.760230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:24.766411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:24.766854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:24.767287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:24.767964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:24.768417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:24.768840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:24.896270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:24.903962 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8616c941-14b1-47ad-8d70-d62547db3491 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.148123 Sep 24 14:30:24.904512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 209/424] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:24 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:25.682377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:25.683013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:25.689334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:25.689808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:25.691003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:25.691690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:25.692138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:25.692557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:25.817688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:25.825551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7c04da2b-8210-48df-90df-379264e29237 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.146920 Sep 24 14:30:25.826745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 216/425] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:25 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:25.929879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:25.930521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:25.936511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:25.936993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:25.937417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:25.938093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:25.938532 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:25.938980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:26.064938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:26.072565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e7b9bdc3-f65d-40b7-a284-773f38edfa91 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.146596 Sep 24 14:30:26.073116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 210/426] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:25 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:26.849582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:26.850181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:26.856462 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:26.856935 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:26.857358 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:26.858028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:26.858472 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:26.858924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:26.999555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:27.007062 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0b88f756-fe4d-4e8b-826e-13809ee59b19 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.161855 Sep 24 14:30:27.007605 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 217/427] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:26 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:27.094750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:27.095382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:27.101909 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:27.102393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:27.102851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:27.103539 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:27.103987 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:27.104404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:27.232469 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:27.239927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e3dcad89-c267-41bd-b19f-ddbecaf01796 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.148944 Sep 24 14:30:27.240489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 211/428] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:27 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:30:28.029461 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:28.030120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:28.036742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:28.037499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:28.037936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:28.038605 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:28.039074 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:28.039490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:28.176103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:28.183910 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e33f3fa7-9ee7-4ec9-bacb-1d51877e90fc tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.158221 Sep 24 14:30:28.184639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 218/429] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:28 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:28.261230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:28.261837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:28.267663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:28.268146 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:28.268602 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:28.269278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:28.269721 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:28.270493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:28.400932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:28.409342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3a9e76ad-af4d-432f-b30f-800155b79efe tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.151416 Sep 24 14:30:28.409987 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 212/430] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:28 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:29.207578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:29.208192 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:29.214450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:29.214973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:29.215411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:29.216094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:29.216555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:29.216977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:29.346360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:29.354379 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b4ff3387-3cfa-47fd-b45e-748f52ed48be tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.151288 Sep 24 14:30:29.354945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 219/431] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:29 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:29.431844 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:29.432384 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:29.438150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:29.438621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:29.439087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:29.439768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:29.440858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:29.441276 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:29.562942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:29.571116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e197f90b-a6cb-4641-9ce2-bf2b4f94443b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.143051 Sep 24 14:30:29.571660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 213/432] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:29 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:30.378049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:30.378049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:30.384660 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:30.385163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:30.385599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:30.386303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:30.386758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:30.387298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:30.538576 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:30.549703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e455f974-049f-4f77-aa5c-a13601614a6b tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.175994 Sep 24 14:30:30.550332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 220/433] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:30 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:30.595591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:30.596303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:30.602337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:30.603153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:30.603651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:30.604406 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:30.605906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:30.606331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:30.766337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:30.775925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ce834610-5688-4ce8-8016-8b926c9bb48c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.183985 Sep 24 14:30:30.776894 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 214/434] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:30 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:31.572699 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:31.573354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:31.580205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:31.580681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:31.583556 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:31.584876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:31.585952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:31.586714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:31.739191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:31.746864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-47368973-73d1-44a5-bf44-3fbcd8194bd5 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1319 microversion: 2.1 time: 0.178195 Sep 24 14:30:31.747416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 221/435] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:31 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:31.802355 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:31.803204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:31.811887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:31.812665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:31.813379 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:31.814528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:31.815253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:31.822099 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:31.959323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:31.969113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-140cc16f-ea77-4193-aab1-6d3e81b74d81 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.172947 Sep 24 14:30:31.969688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 215/436] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:31 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:32.769660 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:32.770200 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:32.776916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:32.777398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:32.777833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:32.778522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:32.779008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:32.779866 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:32.915596 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:32.923393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c466c813-c726-49f8-af6f-431e7722c759 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1508 microversion: 2.1 time: 0.157757 Sep 24 14:30:32.923993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 222/437] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:32 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:32.948878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5f0e724-c456-4fb9-9c7b-9873a311ad1a", "device": "/dev/sdb"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:32.951930 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:32.957987 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:32.958463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:32.958919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:32.959599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:32.960041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:32.960474 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:32.994316 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:32.995016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:33.003741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:33.004229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:33.004663 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:33.005361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:33.005818 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:33.006238 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:33.153745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:33.162626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-42d466e1-f1ac-4d1c-adba-1434db21185a tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.173574 Sep 24 14:30:33.163219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 223/438] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:32 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:30:33.476052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4f722933-3723-4074-8633-e660a0d235ad tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "POST /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532538 Sep 24 14:30:33.476730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 216/439] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:30:32 2022] POST /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:30:34.185944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:34.186892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:34.194770 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:34.195615 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:34.196058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:34.196789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:34.197249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:34.197802 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:34.345433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:34.353653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-79e98d58-d90a-46ee-8d98-22a050eebb82 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.171915 Sep 24 14:30:34.354154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 224/440] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:34 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:34.781827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-6eda1715-9404-4687-80c4-0ad09f85f926 req-f6eca6a7-42e0-452e-b79b-f876e84580b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6521b9ab-7bd9-4568-bd81-d24b8f91f198", "name": "network-vif-plugged", "status": "completed", "tag": "f7e81c8b-495e-44bd-8e81-16cff8e8588d"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:34.794194 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6eda1715-9404-4687-80c4-0ad09f85f926 req-f6eca6a7-42e0-452e-b79b-f876e84580b9 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:34.794682 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6eda1715-9404-4687-80c4-0ad09f85f926 req-f6eca6a7-42e0-452e-b79b-f876e84580b9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:34.795144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6eda1715-9404-4687-80c4-0ad09f85f926 req-f6eca6a7-42e0-452e-b79b-f876e84580b9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:34.806344 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-6eda1715-9404-4687-80c4-0ad09f85f926 req-f6eca6a7-42e0-452e-b79b-f876e84580b9 service nova] Creating event network-vif-plugged:f7e81c8b-495e-44bd-8e81-16cff8e8588d for instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 on hv-cinder-85919 Sep 24 14:30:34.811797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-6eda1715-9404-4687-80c4-0ad09f85f926 req-f6eca6a7-42e0-452e-b79b-f876e84580b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 Sep 24 14:30:34.812595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 217/441] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:30:35.376974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:35.382575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:35.384814 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:35.385300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:35.385721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:35.386404 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:35.386876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:35.387299 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:35.527085 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:35.535025 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fe1c527b-bd6d-4051-bfdf-db203905a795 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.161938 Sep 24 14:30:35.535583 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 225/442] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:35 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:36.558067 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:36.558757 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:36.565635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:36.566126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:36.566554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:36.567257 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:36.567704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:36.568119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:36.703868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:36.715114 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f57aab8d-2aee-49b7-ae51-7688ffa2ac63 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1314 microversion: 2.1 time: 0.160594 Sep 24 14:30:36.715874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 218/443] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:36 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:37.738536 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:37.739505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:37.745978 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:37.746455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:37.746923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:37.747602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:37.748045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:37.748460 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:37.879565 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:37.887124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-340a74ef-7ff8-4799-b602-f147bd5dfeaf tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1498 microversion: 2.1 time: 0.153530 Sep 24 14:30:37.887683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 226/444] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:37 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:38.418356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:38.418869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:38.425259 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:38.425736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:38.426165 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:38.426873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:38.427327 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:38.427748 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:38.451781 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:30:38.525663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-91d5978d-c409-41d9-a82a-5e81a9c49d25 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 204 len: 0 microversion: 2.1 time: 0.110882 Sep 24 14:30:38.526318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 219/445] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:30:38 2022] DELETE /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:30:38.537033 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:38.537647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:38.543697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:38.544178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:38.544608 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:38.545285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:38.545740 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:38.546160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:38.675898 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:38.683548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9e25be7e-fcb5-49eb-abff-4198d922b9c0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1504 microversion: 2.1 time: 0.152797 Sep 24 14:30:38.684106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 227/446] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:38 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:39.706696 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:39.707415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:39.713726 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:39.714204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:39.714634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:39.715350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:39.715802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:39.716221 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:39.842412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:39.850534 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5fa3e707-0263-486d-aa4d-7810a3aab88d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1504 microversion: 2.1 time: 0.148092 Sep 24 14:30:39.851127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 220/447] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:39 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:40.873921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:40.874610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:40.881531 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:40.881978 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:40.882434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:40.883140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:40.883582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:40.884671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:41.012942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:41.020575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d9b2b6c0-71a0-4eaa-9106-de443496bdd7 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1504 microversion: 2.1 time: 0.150567 Sep 24 14:30:41.021135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 228/448] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:40 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:42.043341 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:42.044228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:42.055764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:42.056328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:42.056961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:42.057676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:42.058130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:42.058556 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:42.090236 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-f93ec9ca-d10f-4210-9d1e-458b51daa6ec req-8265647b-fb8f-43b7-a20f-1aa65b69ddcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6521b9ab-7bd9-4568-bd81-d24b8f91f198", "name": "network-vif-deleted", "tag": "f7e81c8b-495e-44bd-8e81-16cff8e8588d"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:42.100592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-f93ec9ca-d10f-4210-9d1e-458b51daa6ec req-8265647b-fb8f-43b7-a20f-1aa65b69ddcb service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:42.101185 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-f93ec9ca-d10f-4210-9d1e-458b51daa6ec req-8265647b-fb8f-43b7-a20f-1aa65b69ddcb service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:42.101797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-f93ec9ca-d10f-4210-9d1e-458b51daa6ec req-8265647b-fb8f-43b7-a20f-1aa65b69ddcb service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:42.105625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:42.115766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-f93ec9ca-d10f-4210-9d1e-458b51daa6ec req-8265647b-fb8f-43b7-a20f-1aa65b69ddcb service nova] Creating event network-vif-deleted:f7e81c8b-495e-44bd-8e81-16cff8e8588d for instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 on hv-cinder-85919 Sep 24 14:30:42.121440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-f93ec9ca-d10f-4210-9d1e-458b51daa6ec req-8265647b-fb8f-43b7-a20f-1aa65b69ddcb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034449 Sep 24 14:30:42.122037 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 229/449] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:30:42.132211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:42.140028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d0a9762d-66c4-4fbf-a82e-f6af502c69c1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 200 len: 1462 microversion: 2.1 time: 0.100387 Sep 24 14:30:42.140586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 221/450] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:42 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 1462 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:43.165180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:43.165882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 6521b9ab-7bd9-4568-bd81-d24b8f91f198] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:43.171966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:43.172445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:43.172877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:43.173555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:43.174005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:43.174426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:43.187357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] HTTP exception thrown: Instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 could not be found. Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Request method failure captured: Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 HTTP/1.1 Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxRnU5bQX6uLOEJmbOJzIdUvkaEnfwxMzylC9j4RsWCYbaCHZhoCtlAcYT-v8_Rd44Yvspj3I8oYhQ5dmmKRPwe4m3tbcMAsdHjdrkFX2S77KXi8YEXBHkhZ-5JPOYEfnrS-XRak6cZa5WphKcTazS18fzSUL4qWE8KEuFImfCSLd44 Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 5ab7af1a1c6749548a6ed520b119d868 Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesActionsTest-1691961417 Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:30:43.188927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ab7af1a1c6749548a6ed520b119d868"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5ab7af1a1c6749548a6ed520b119d868", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ab7af1a1c6749548a6ed520b119d868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5ab7af1a1c6749548a6ed520b119d868"}]}] Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesActionsTest-1691961417 Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 5ab7af1a1c6749548a6ed520b119d868 Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesActionsTest-1691961417 Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesActionsTest-1691961417-project Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: e22e1db5255c4ac0903d94a382069db6 Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesActionsTest-1691961417-project Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 could not be found. Sep 24 14:30:43.190411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '6521b9ab-7bd9-4568-bd81-d24b8f91f198'} Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 could not be found. Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:30:43.191184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 could not be found. Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 could not be found. Sep 24 14:30:43.192390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:30:43.193432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Returning 404 to user: Instance 6521b9ab-7bd9-4568-bd81-d24b8f91f198 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:30:43.193432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6e91cac5-c2c4-4860-9b5d-cf8c06fdcd0b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198" status: 404 len: 111 microversion: 2.1 time: 0.029830 Sep 24 14:30:43.193432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 230/451] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:43 2022] GET /compute/v2.1/servers/6521b9ab-7bd9-4568-bd81-d24b8f91f198 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:30:43.301410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1714203058", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "networks": [{"uuid": "5cde2b2a-2e0e-44db-bb33-6d4b4863e498"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:43.356451 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] validate_networks() for [('5cde2b2a-2e0e-44db-bb33-6d4b4863e498', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:30:43.688496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:30:43.688916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:30:43.689382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:30:43.690386 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:30:43.690792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:30:43.699534 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:43.700011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:43.700443 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:43.701153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:43.701599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:43.702017 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:43.718181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Getting quotas for project 5ab7af1a1c6749548a6ed520b119d868. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:30:43.722063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Getting quotas for user e22e1db5255c4ac0903d94a382069db6 and project 5ab7af1a1c6749548a6ed520b119d868. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:30:43.732797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:30:43.735058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:30:43.779322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-229b5816-f037-44d2-b7fe-d00b00514b38 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481685 Sep 24 14:30:43.779953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 222/452] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:30:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:30:43.791240 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9b6d1c92-1187-46c3-9bf3-051394510f45 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:43.791880 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9b6d1c92-1187-46c3-9bf3-051394510f45 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:43.847026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9b6d1c92-1187-46c3-9bf3-051394510f45 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:43.853792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9b6d1c92-1187-46c3-9bf3-051394510f45 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1214 microversion: 2.1 time: 0.066433 Sep 24 14:30:43.854514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 231/453] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:43 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:44.877946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:44.878545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:44.885001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:44.885475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:44.885903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:44.886570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:44.887060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:44.887473 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:44.902285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:44.948202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:44.956249 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5e95102d-a999-49f3-b48c-fd77d70b4f36 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1218 microversion: 2.1 time: 0.083211 Sep 24 14:30:44.956795 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 223/454] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:44 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:45.978709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:45.979336 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:45.986393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:45.986892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:45.987322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:45.987998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:45.988453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:45.988862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:46.047266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:46.054707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c66a7f61-9dce-4304-8244-8f5f2bcf2351 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1218 microversion: 2.1 time: 0.079969 Sep 24 14:30:46.055277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 232/455] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:45 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:47.077225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:47.077864 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:47.084837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:47.085383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:47.085751 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:47.086433 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:47.086913 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:47.087338 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:47.157314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:47.166649 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b3cf8bb6-081c-4fb8-af0f-4dc98dbef500 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1218 microversion: 2.1 time: 0.093158 Sep 24 14:30:47.167255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 224/456] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:47 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:48.191812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:48.192426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:48.198968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:48.199454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:48.199892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:48.200589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:48.201046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:48.201468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:48.280142 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:48.288504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-af12f762-e2c9-4311-8ebb-a4f7ad1a58c6 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1272 microversion: 2.1 time: 0.100624 Sep 24 14:30:48.289063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 233/457] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:48 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:49.310953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:49.311567 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:49.313902 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:49.319227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:49.319710 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:49.320144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:49.320829 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:49.321277 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:49.321693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:49.451962 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:49.460238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-07b20c83-d427-4524-a8ce-b214f4dd369d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.153187 Sep 24 14:30:49.460796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 225/458] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:49 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:49.547479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-bc037242-de94-4908-a2e9-def7d912b7dc req-e86db193-15df-4d04-8060-4d6455ff71d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf437f3-c729-48f5-b474-914ea5b3aa8f", "tag": "0e857250-96cd-4cff-87a6-420dd967c7d7"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:30:49.558017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-bc037242-de94-4908-a2e9-def7d912b7dc req-e86db193-15df-4d04-8060-4d6455ff71d4 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:49.558508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-bc037242-de94-4908-a2e9-def7d912b7dc req-e86db193-15df-4d04-8060-4d6455ff71d4 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:49.559789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-bc037242-de94-4908-a2e9-def7d912b7dc req-e86db193-15df-4d04-8060-4d6455ff71d4 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:49.571085 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-bc037242-de94-4908-a2e9-def7d912b7dc req-e86db193-15df-4d04-8060-4d6455ff71d4 service nova] Creating event network-changed:0e857250-96cd-4cff-87a6-420dd967c7d7 for instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f on hv-cinder-85919 Sep 24 14:30:49.575918 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-bc037242-de94-4908-a2e9-def7d912b7dc req-e86db193-15df-4d04-8060-4d6455ff71d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Sep 24 14:30:49.576498 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 234/459] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:30:50.482670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:50.483306 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:50.490184 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:50.490668 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:50.491138 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:50.491826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:50.492279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:50.492703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:50.623356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:50.632022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-323e7d01-dde1-4db9-8009-3ac8992c4167 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.153192 Sep 24 14:30:50.632575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 226/460] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:50 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:51.655191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:51.655881 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:51.658538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=50 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:51.664339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:51.664816 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:51.665245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:51.665919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:51.666364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:51.666778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:51.795061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:51.802564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6a300b02-773b-41e1-ae45-e1994f79a81f tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.151589 Sep 24 14:30:51.803156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 235/461] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:51 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:52.825521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:52.826128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:52.833036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:52.833509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:52.833942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:52.834620 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:52.835094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:52.835511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:52.958073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:52.965503 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6f115d2d-bf93-45a2-ac55-d40becfc936b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.143936 Sep 24 14:30:52.966066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 227/462] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:52 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:53.989262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:53.989899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:53.992242 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:53.997359 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:53.997838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:53.998262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:53.998967 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:53.999409 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:53.999823 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:54.128902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:54.136592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-531cba41-0285-47a4-9ad8-3a03296c6715 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.151491 Sep 24 14:30:54.137147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 236/463] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:53 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:55.160563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:55.161158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:55.163001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:55.163743 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:55.169772 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:55.170251 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:55.170685 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:55.171394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:55.171847 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:55.172264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:55.300834 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:55.308433 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4b38a9d6-9b78-4791-aee6-4c7837d557ea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.151778 Sep 24 14:30:55.308977 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 228/464] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:55 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:56.331554 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:56.332061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:56.338496 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:56.338998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:56.339426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:56.340091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:56.340533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:56.340944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:56.469749 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:56.477204 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-35de6d5f-c4de-4679-9da8-6ecd63be5bea tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.150186 Sep 24 14:30:56.477868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 237/465] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:56 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:57.501415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:57.502019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:57.508218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:57.508692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:57.509190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:57.509864 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:57.510382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:57.510831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:57.640386 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:57.648525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1e2fe3f0-f8f4-4e19-b7a5-307ef870d4d5 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.151019 Sep 24 14:30:57.649071 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 229/466] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:57 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:58.135865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:58.136415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:58.142674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:58.143181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:58.143642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:58.144318 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:58.144767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:58.145186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:58.265515 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lazy-loading 'services' on Instance uuid b1c44be5-8822-4ba2-b0be-4431ac14f185 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:30:58.381130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-57885303-2da3-4ede-a510-965b35e24498 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185/os-volume_attachments/c5f0e724-c456-4fb9-9c7b-9873a311ad1a" status: 202 len: 0 microversion: 2.1 time: 0.248990 Sep 24 14:30:58.381727 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 238/467] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:30:58 2022] DELETE /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185/os-volume_attachments/c5f0e724-c456-4fb9-9c7b-9873a311ad1a => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:30:58.672896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:58.673632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:58.681372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:58.682173 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:58.682431 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:58.684407 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:58.685145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:58.685628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:58.824837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:30:58.832966 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c6706603-9b69-4213-88a0-aa22e955f8ef tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.164013 Sep 24 14:30:58.833524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 230/468] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:58 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:30:59.856424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:30:59.857110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:30:59.863277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:59.863754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:59.864178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:59.864849 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:30:59.865293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:30:59.865709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:30:59.994575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:00.002922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f85dd2e1-793e-463d-8403-ced430bf775b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.151167 Sep 24 14:31:00.003555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 239/469] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:30:59 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:00.560408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:00.560906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:00.567194 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:00.567674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:00.568107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:00.568786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:00.569235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:00.569653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:00.595316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:31:00.672362 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9074998a-6651-41ab-8ba2-d1ffae9d6739 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 204 len: 0 microversion: 2.1 time: 0.115351 Sep 24 14:31:00.672942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 231/470] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:31:00 2022] DELETE /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:31:00.681626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:00.682310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:00.688174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:00.688763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:00.689277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:00.689979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:00.690408 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:00.690846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:00.822020 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:00.830198 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4ac812f3-4dd5-47d7-bb4a-fb7438cd84ff tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1514 microversion: 2.1 time: 0.152390 Sep 24 14:31:00.830751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 240/471] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:00 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:01.026004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:01.026610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:01.032714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:01.033857 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:01.034285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:01.034986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:01.035431 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:01.035846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:01.160787 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:01.168304 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5d13c5e1-d936-4f17-bc39-c5f58c62e7aa tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.146580 Sep 24 14:31:01.168872 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 232/472] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:01 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:31:01.493734 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-47a1c679-39b8-4230-93f8-f22b7e1550d5 req-143b30d3-b80a-4678-b682-304c2d48a3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf437f3-c729-48f5-b474-914ea5b3aa8f", "name": "network-vif-plugged", "status": "completed", "tag": "0e857250-96cd-4cff-87a6-420dd967c7d7"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:01.504473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-47a1c679-39b8-4230-93f8-f22b7e1550d5 req-143b30d3-b80a-4678-b682-304c2d48a3de service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:01.504946 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-47a1c679-39b8-4230-93f8-f22b7e1550d5 req-143b30d3-b80a-4678-b682-304c2d48a3de service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:01.505368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-47a1c679-39b8-4230-93f8-f22b7e1550d5 req-143b30d3-b80a-4678-b682-304c2d48a3de service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:01.516342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-47a1c679-39b8-4230-93f8-f22b7e1550d5 req-143b30d3-b80a-4678-b682-304c2d48a3de service nova] Creating event network-vif-plugged:0e857250-96cd-4cff-87a6-420dd967c7d7 for instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f on hv-cinder-85919 Sep 24 14:31:01.521601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-47a1c679-39b8-4230-93f8-f22b7e1550d5 req-143b30d3-b80a-4678-b682-304c2d48a3de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032141 Sep 24 14:31:01.522170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 241/473] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:31:01.853533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:01.854142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:01.860534 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:01.861012 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:01.861950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:01.862625 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:01.863110 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:01.863529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:01.990338 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:01.998094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d2da6915-a620-4394-9247-b0b600edb501 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1514 microversion: 2.1 time: 0.148448 Sep 24 14:31:01.998652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 233/474] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:01 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:02.192499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:02.193566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:02.199558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:02.200032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:02.200458 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:02.201130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:02.201575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:02.201987 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:02.387231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:02.395273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-29857de9-dea9-4c77-ba66-048c1ce6aabd tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.207664 Sep 24 14:31:02.395828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 242/475] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:02 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:03.022163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:03.022760 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:03.029248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:03.029724 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:03.030151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:03.031108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:03.031556 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:03.032003 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:03.157619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:03.165134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-14f388df-4ce7-4548-82d0-ca78dc77ed85 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1514 microversion: 2.1 time: 0.147473 Sep 24 14:31:03.165683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 234/476] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:03 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:03.418485 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:03.419142 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:03.425947 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:03.426424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:03.426883 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:03.427564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:03.428014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:03.428431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:03.557863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:03.565445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8b60598d-982a-4a77-b6f4-2b64cb240f47 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.150841 Sep 24 14:31:03.566005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 243/477] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:03 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:04.190738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:04.191353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:04.198015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:04.198468 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:04.198921 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:04.199594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:04.200042 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:04.200454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:04.327257 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:04.335594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8b3ceb61-fd4f-441a-bf97-1254c43e0644 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1514 microversion: 2.1 time: 0.150663 Sep 24 14:31:04.336161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 235/478] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:04 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:04.587905 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:04.588448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:04.594642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:04.595159 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:04.595597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:04.596285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:04.596739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:04.597160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:04.724905 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:04.732361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c6f1eac0-a68d-49b0-99cd-4b7d5c3bb64b tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1314 microversion: 2.1 time: 0.148377 Sep 24 14:31:04.732915 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 244/479] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:04 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:05.286910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-b7bf0825-2cd5-495d-8e0a-e4e39c471536 req-27c5cb65-1fba-45f5-88a2-5ebf172e700c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c44be5-8822-4ba2-b0be-4431ac14f185", "name": "network-vif-deleted", "tag": "efe264bb-2645-4dc3-899c-304f3587db1e"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:05.297401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b7bf0825-2cd5-495d-8e0a-e4e39c471536 req-27c5cb65-1fba-45f5-88a2-5ebf172e700c service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:05.297880 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b7bf0825-2cd5-495d-8e0a-e4e39c471536 req-27c5cb65-1fba-45f5-88a2-5ebf172e700c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:05.298308 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b7bf0825-2cd5-495d-8e0a-e4e39c471536 req-27c5cb65-1fba-45f5-88a2-5ebf172e700c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:05.309595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-b7bf0825-2cd5-495d-8e0a-e4e39c471536 req-27c5cb65-1fba-45f5-88a2-5ebf172e700c service nova] Creating event network-vif-deleted:efe264bb-2645-4dc3-899c-304f3587db1e for instance b1c44be5-8822-4ba2-b0be-4431ac14f185 on hv-cinder-85919 Sep 24 14:31:05.314995 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-b7bf0825-2cd5-495d-8e0a-e4e39c471536 req-27c5cb65-1fba-45f5-88a2-5ebf172e700c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032339 Sep 24 14:31:05.315568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 236/480] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:31:05.357356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:05.357987 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:05.365051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:05.365896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:05.366330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:05.367043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:05.367491 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:05.367912 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:05.430390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd381a365e0744834b716fa6b0ea18d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e584f45faa47afa4ced9db997f4e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:05.438535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4d3f0511-7a3c-4d57-8247-e6427f4faa46 tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 200 len: 1304 microversion: 2.1 time: 0.084962 Sep 24 14:31:05.439144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 245/481] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:05 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:05.706066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:05.708467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:05.714479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:05.714999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:05.715430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:05.716109 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:05.716556 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:05.716975 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:05.756242 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:05.756796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:05.763020 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:05.763495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:05.763920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:05.764590 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:05.765086 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:05.765504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:05.894403 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:05.901899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c185262e-d1ef-4571-9c6a-234a76bc38a1 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1497 microversion: 2.1 time: 0.150050 Sep 24 14:31:05.902450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 246/482] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:05 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:31:06.027485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7edb8ce4-5815-46a5-8986-01adcec35f2c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/action" status: 200 len: 33732 microversion: 2.20 time: 0.325835 Sep 24 14:31:06.028333 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 237/483] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 14:31:05 2022] POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/action => generated 33732 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:31:06.461809 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:06.462270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] [instance: b1c44be5-8822-4ba2-b0be-4431ac14f185] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:06.468050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:06.468528 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:06.469012 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:06.469688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:06.470131 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:06.470544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:06.477095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:06.477668 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:06.484903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:06.485376 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:06.485491 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] HTTP exception thrown: Instance b1c44be5-8822-4ba2-b0be-4431ac14f185 could not be found. Sep 24 14:31:06.485805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:06.486479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Request method failure captured: Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 HTTP/1.1 Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxPXPzE-gXasBH8LB12b9Uzp2pFHW62ylGOVzrcUFHvpjB9a1n5G_9Fs1d4tHH-yFi6VeNF100vu9OggoYDxcR0kh5TUkqqQmL0zpiION145SbL6w5h30E-C18rNg9VxaSAl7uSg9MwTlS8cq3Qagx0ZWVa12eD8RXz8lY6JLqu4O84 Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 27e584f45faa47afa4ced9db997f4e4a Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesSnapshotTestJSON-913420090 Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:31:06.487589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/27e584f45faa47afa4ced9db997f4e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_27e584f45faa47afa4ced9db997f4e4a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/27e584f45faa47afa4ced9db997f4e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/27e584f45faa47afa4ced9db997f4e4a"}]}] Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesSnapshotTestJSON-913420090 Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 27e584f45faa47afa4ced9db997f4e4a Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-913420090 Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesSnapshotTestJSON-913420090-project Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: d381a365e0744834b716fa6b0ea18d3d Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesSnapshotTestJSON-913420090-project Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance b1c44be5-8822-4ba2-b0be-4431ac14f185 could not be found. Sep 24 14:31:06.489186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'b1c44be5-8822-4ba2-b0be-4431ac14f185'} Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c44be5-8822-4ba2-b0be-4431ac14f185 could not be found. Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:31:06.490551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c44be5-8822-4ba2-b0be-4431ac14f185 could not be found. Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c44be5-8822-4ba2-b0be-4431ac14f185 could not be found. Sep 24 14:31:06.492432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:06.493776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:06.493776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:06.493920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] Returning 404 to user: Instance b1c44be5-8822-4ba2-b0be-4431ac14f185 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:31:06.493920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3aa15be3-ccd9-48cb-b45a-3be8e299996f tempest-VolumesSnapshotTestJSON-913420090 tempest-VolumesSnapshotTestJSON-913420090-project] 10.222.0.52 "GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185" status: 404 len: 111 microversion: 2.1 time: 0.031390 Sep 24 14:31:06.493920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 247/484] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:06 2022] GET /compute/v2.1/servers/b1c44be5-8822-4ba2-b0be-4431ac14f185 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:31:06.520217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:31:06.543935 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:06.599231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1bc274b7-efa5-45ca-92a9-4ff1ce1a840c tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 204 len: 0 microversion: 2.1 time: 0.125863 Sep 24 14:31:06.600402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 238/485] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:31:06 2022] DELETE /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 14:31:06.608871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:06.609485 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:06.615964 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:06.616447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:06.616884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:06.617587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:06.618017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:06.618440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:06.923879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:06.931528 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-27a89c7f-5355-4b49-87a8-a4cf1ff5cd19 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1503 microversion: 2.1 time: 0.326606 Sep 24 14:31:06.932088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 248/486] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:06 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:07.956338 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:07.957147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:07.964690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:07.965190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:07.965619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:07.966286 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:07.966731 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:07.967175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:08.367305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:08.375405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8aca7df8-28a1-403b-a7fa-24cdd53b6d5d tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1503 microversion: 2.1 time: 0.424285 Sep 24 14:31:08.376009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 239/487] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:07 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:31:08.933072 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:08.933619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:08.939923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:08.940395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:08.940823 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:08.941490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:08.941934 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:08.942349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:08.958493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:08.966723 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8de06289-ba7d-4d9e-ae8e-a371836b54be tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.037594 Sep 24 14:31:08.967295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 249/488] 10.222.0.52 () {60 vars in 1289 bytes} [Sat Sep 24 14:31:08 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:31:09.398902 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:09.399516 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:09.406142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:09.406663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:09.407122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:09.407805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:09.408258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:09.408711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:09.532722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:09.540940 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-62951582-e80a-4414-b556-f13d60f0e3a0 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1503 microversion: 2.1 time: 0.145922 Sep 24 14:31:09.541524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 240/489] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:09 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:10.564719 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:10.565240 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:10.571782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:10.572252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:10.572679 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:10.573346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:10.573788 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:10.574203 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:10.698486 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:10.706648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-744a0013-92f8-4446-a4b2-609bc6ccf5ab tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1503 microversion: 2.1 time: 0.145844 Sep 24 14:31:10.707232 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 250/490] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:10 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:11.729526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:11.730136 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:11.736491 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:11.736968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:11.737440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:11.738171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:11.738644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:11.739324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:11.868062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:11.875792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-db5a9753-7946-4d1f-9070-ba00eac24389 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1503 microversion: 2.1 time: 0.150183 Sep 24 14:31:11.876354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 241/491] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:11 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:12.899933 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:12.901089 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:12.905937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-7d9a3b31-87c9-40d8-bf09-ec386469484c req-1478fd69-aa89-40dc-92b6-ed0faee6a5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf437f3-c729-48f5-b474-914ea5b3aa8f", "name": "network-vif-deleted", "tag": "0e857250-96cd-4cff-87a6-420dd967c7d7"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:12.908536 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:12.909249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:12.909756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:12.911243 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:12.911699 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:12.912319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:12.916809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7d9a3b31-87c9-40d8-bf09-ec386469484c req-1478fd69-aa89-40dc-92b6-ed0faee6a5ec service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:12.917276 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7d9a3b31-87c9-40d8-bf09-ec386469484c req-1478fd69-aa89-40dc-92b6-ed0faee6a5ec service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:12.917703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7d9a3b31-87c9-40d8-bf09-ec386469484c req-1478fd69-aa89-40dc-92b6-ed0faee6a5ec service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:12.929352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-7d9a3b31-87c9-40d8-bf09-ec386469484c req-1478fd69-aa89-40dc-92b6-ed0faee6a5ec service nova] Creating event network-vif-deleted:0e857250-96cd-4cff-87a6-420dd967c7d7 for instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f on hv-cinder-85919 Sep 24 14:31:12.934187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-7d9a3b31-87c9-40d8-bf09-ec386469484c req-1478fd69-aa89-40dc-92b6-ed0faee6a5ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032610 Sep 24 14:31:12.935225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 242/492] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:31:12.977239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e22e1db5255c4ac0903d94a382069db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab7af1a1c6749548a6ed520b119d868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:12.985084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-267a7cd9-ecf8-4d65-802d-73d0811b15d8 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 200 len: 1461 microversion: 2.1 time: 0.090401 Sep 24 14:31:12.987358 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 251/493] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:12 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:13.993914 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:13.994522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:14.000631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:14.001108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:14.001536 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:14.002911 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:14.003308 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:14.003783 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:14.010704 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:14.011399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] [instance: 8cf437f3-c729-48f5-b474-914ea5b3aa8f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:14.018666 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:14.019189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:14.019623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:14.020310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:14.020765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:14.021188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:14.027322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lazy-loading 'flavor' on Instance uuid 153f3eef-0f34-4a4a-8738-274bcb2737ca {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:31:14.034586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] HTTP exception thrown: Instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f could not be found. Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Request method failure captured: Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f HTTP/1.1 Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxRnU5bQX6uLOEJmbOJzIdUvkaEnfwxMzylC9j4RsWCYbaCHZhoCtlAcYT-v8_Rd44Yvspj3I8oYhQ5dmmKRPwe4m3tbcMAsdHjdrkFX2S77KXi8YEXBHkhZ-5JPOYEfnrS-XRak6cZa5WphKcTazS18fzSUL4qWE8KEuFImfCSLd44 Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 5ab7af1a1c6749548a6ed520b119d868 Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesActionsTest-1691961417 Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:31:14.036134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ab7af1a1c6749548a6ed520b119d868"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5ab7af1a1c6749548a6ed520b119d868", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ab7af1a1c6749548a6ed520b119d868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5ab7af1a1c6749548a6ed520b119d868"}]}] Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesActionsTest-1691961417 Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 5ab7af1a1c6749548a6ed520b119d868 Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesActionsTest-1691961417 Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesActionsTest-1691961417-project Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: e22e1db5255c4ac0903d94a382069db6 Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesActionsTest-1691961417-project Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f could not be found. Sep 24 14:31:14.037672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '8cf437f3-c729-48f5-b474-914ea5b3aa8f'} Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f could not be found. Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:31:14.038722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f could not be found. Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f could not be found. Sep 24 14:31:14.040264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:31:14.041506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] Returning 404 to user: Instance 8cf437f3-c729-48f5-b474-914ea5b3aa8f could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:31:14.041506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ef81b136-3851-4697-9033-6fa68c28c4a9 tempest-VolumesActionsTest-1691961417 tempest-VolumesActionsTest-1691961417-project] 10.222.0.52 "GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f" status: 404 len: 111 microversion: 2.1 time: 0.030758 Sep 24 14:31:14.041506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 252/494] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:14 2022] GET /compute/v2.1/servers/8cf437f3-c729-48f5-b474-914ea5b3aa8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 14:31:14.266361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f8aecdc7-b274-478b-b33c-8c413bd07bae tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/action" status: 202 len: 0 microversion: 2.20 time: 0.277103 Sep 24 14:31:14.267187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 243/495] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 14:31:13 2022] POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:31:14.276058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:14.276560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:14.282848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:14.283535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:14.284253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:14.285807 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:14.286360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:14.286787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:14.425239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:14.433544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:14.435103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:14.436271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a5b707f2-3de6-42c7-8d20-43f07d9937a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.164151 Sep 24 14:31:14.437325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 253/496] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:14 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:15.464999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:15.465687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:15.472345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:15.472823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:15.473253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:15.473932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:15.474380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:15.474796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:15.599676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:15.607756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:15.609282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:15.610434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fde4360a-2c5f-454f-ac5b-098dfcdca7a1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.150279 Sep 24 14:31:15.611014 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 244/497] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:15 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:16.635916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:16.636557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:16.643444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:16.643921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:16.644351 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:16.645037 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:16.645488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:16.645909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:16.769765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:16.777715 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:16.779183 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:16.780325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-aca30f22-7934-4d9b-b7d5-ec7ed1498871 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.148293 Sep 24 14:31:16.781124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 254/498] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:16 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:17.806096 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:17.806728 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:17.813652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:17.814137 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:17.814568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:17.815405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:17.816124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:17.816552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:17.954102 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:17.962075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:17.963548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:17.964675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d04e9472-a16d-4bb2-988a-6d0ea84be247 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.162518 Sep 24 14:31:17.965215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 245/499] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:17 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:18.989863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:18.990463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:18.997115 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:18.997589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:18.998014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:18.998680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:18.999149 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:18.999563 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:19.129054 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:19.137996 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:19.139854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:19.141000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d776b8eb-413f-4400-9b74-f7594848e81f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.155520 Sep 24 14:31:19.141539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 255/500] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:18 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:20.165329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:20.165932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:20.168380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:20.173780 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:20.174267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:20.174697 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:20.175414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:20.175861 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:20.176286 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:20.302910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:20.310774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:20.312234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:20.313376 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-61c49360-ea18-4d8a-8a47-6cbdfcc25184 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.151877 Sep 24 14:31:20.313929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 246/501] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:20 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:21.344185 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:21.345041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:21.352743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:21.353359 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:21.353892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:21.354865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:21.355537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:21.356076 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:21.510220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:21.521756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:21.523248 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:21.524407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-67b30bb1-a058-4c7e-9df0-27057d312c96 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.188496 Sep 24 14:31:21.525251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 256/502] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:21 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:22.677122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:22.678769 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:22.688016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:22.688905 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:22.689989 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:22.690994 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:22.691703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:22.692481 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:22.827344 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:22.839040 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:22.840942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:22.842113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ac55b27e-ec18-4756-a656-3166b4a62996 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.296183 Sep 24 14:31:22.842668 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 247/503] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:22 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:23.869939 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:23.870540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:23.872813 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=44 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:23.878362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:23.878847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:23.879279 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:23.879949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:23.880391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:23.880803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:24.007818 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:24.016018 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:24.018091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:24.019711 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8718094d-acb3-4d14-9417-53a6722f2968 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.153541 Sep 24 14:31:24.020250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 257/504] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:23 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:25.044528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:25.045129 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:25.052220 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:25.052695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:25.053120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:25.053792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:25.054239 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:25.054650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:25.181371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:25.189976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:25.191458 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:25.192592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-510d5098-6c38-4d7a-bbb1-aa8f4c7be773 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.151983 Sep 24 14:31:25.193146 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 248/505] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:25 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:26.218357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:26.218972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:26.226981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:26.227469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:26.227903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:26.228806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:26.229262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:26.229687 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:26.387052 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:26.395973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:26.397516 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:26.398772 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fcedc7f5-9470-456b-bb64-efddf8173934 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.184812 Sep 24 14:31:26.399432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 258/506] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:26 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:27.426094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:27.427582 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:27.433875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:27.434680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:27.435394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:27.436173 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:27.436849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:27.437604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:27.578186 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:27.587005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:27.590490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:27.591681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a29d6651-7ca9-4993-bd75-226f6470d63a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.170580 Sep 24 14:31:27.592445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 249/507] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:27 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:28.623520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:28.624328 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:28.632373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:28.632907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:28.633330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:28.634190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:28.634860 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:28.635437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:28.799708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:28.813497 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:28.816138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:28.818896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f138375f-099a-4fa8-8058-35e66a6bab20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.199440 Sep 24 14:31:28.820170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 259/508] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:28 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:29.846092 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:29.847319 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:29.853690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:29.854387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:29.854840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:29.855573 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:29.856023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:29.856451 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:30.002808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:30.011843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:30.013507 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:30.014678 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-92ce3402-ca56-4102-9d4f-e45007b2ec2e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.173198 Sep 24 14:31:30.015537 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 250/509] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:29 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:31.042156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:31.043093 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:31.049935 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:31.050918 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:31.051552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:31.052447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:31.053130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:31.053713 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:31.199161 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:31.209137 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:31.210602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:31.211854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9d1bff03-7c20-4398-8156-054da00f0674 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.174255 Sep 24 14:31:31.212650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 260/510] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:31 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:32.238890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:32.239491 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:32.246138 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:32.246553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:32.247057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:32.247743 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:32.248184 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:32.248786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:32.382587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:32.391088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:32.392794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:32.394140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-aff93692-8b38-4407-9698-8495b8239b6c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.159205 Sep 24 14:31:32.394686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 251/511] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:32 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:33.420721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:33.421333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:33.429828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:33.430545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:33.431164 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:33.432032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:33.432841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:33.433435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:33.572327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:33.580761 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:33.582222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:33.583421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7a47ec9c-a790-4c30-aa64-ad8a6d7e069e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.166968 Sep 24 14:31:33.584261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 261/512] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:33 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:31:34.613661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:34.614313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:34.621463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:34.621980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:34.622437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:34.623153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:34.623776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:34.624348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:34.796543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:34.810031 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:34.812633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:34.815283 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1ab83676-cd44-4be7-98dd-583896327f32 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.209105 Sep 24 14:31:34.819544 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 252/513] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:34 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:35.847164 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:35.848502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:35.855917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:35.856820 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:35.857237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:35.857999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:35.858490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:35.858964 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:36.010097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:36.018878 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:36.020312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:36.021455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-86cd35aa-0ae3-48a5-8154-5bb3314be0cc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.178390 Sep 24 14:31:36.022005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 262/514] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:35 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:37.048571 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:37.050148 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:37.061524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:37.062286 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:37.062976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:37.065267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:37.066267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:37.066932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:37.084187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:37.272989 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:37.282648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:37.284170 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:37.285336 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6c66da55-1b03-41de-8ea8-39d956f8d984 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.241785 Sep 24 14:31:37.285886 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 253/515] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:37 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:38.312341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:38.313789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:38.321175 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:38.321730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:38.322403 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:38.323357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:38.324044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:38.324539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:38.508566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:38.527295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:38.529008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:38.530668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-89167db6-d617-4f65-9cc5-4edec9a4d353 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1745 microversion: 2.20 time: 0.221949 Sep 24 14:31:38.531896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 263/516] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:38 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:39.558854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:39.560256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:39.572445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:39.573217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:39.573848 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:39.575067 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:39.579212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:39.579673 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:39.846434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:39.855475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:39.856930 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:39.858133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-50d30673-8a38-484e-90b8-b78dd870b2d7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1745 microversion: 2.20 time: 0.303227 Sep 24 14:31:39.865049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 254/517] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:39 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1745 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:40.886794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:40.889266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:40.902271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:40.903196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:40.904333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:40.908353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:40.909107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:40.909787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:40.914735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=81 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:41.081570 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:41.091152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:41.093654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:41.095683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fe551a81-13d3-40bf-9362-da286a45bcfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1745 microversion: 2.20 time: 0.215188 Sep 24 14:31:41.099943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 264/518] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:40 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:31:42.123262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:42.124143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:42.138308 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:42.139322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:42.148598 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:42.149597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:42.150231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:42.151034 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:42.436396 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:42.448032 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:42.450049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:42.453284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-161aedf4-2160-467b-b6a9-376a14644e80 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1745 microversion: 2.20 time: 0.334000 Sep 24 14:31:42.454967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 255/519] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:42 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1745 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:43.005491 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-59fa505c-0b7e-409c-bc62-f83410882a65 req-ca157744-dfc5-4fb1-b9bc-d282416dc98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153f3eef-0f34-4a4a-8738-274bcb2737ca", "name": "network-vif-plugged", "status": "completed", "tag": "42c66fed-6127-4d44-b2b2-1f1ddaf5a32d"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:43.015510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-59fa505c-0b7e-409c-bc62-f83410882a65 req-ca157744-dfc5-4fb1-b9bc-d282416dc98e service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:43.015990 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-59fa505c-0b7e-409c-bc62-f83410882a65 req-ca157744-dfc5-4fb1-b9bc-d282416dc98e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:43.016494 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-59fa505c-0b7e-409c-bc62-f83410882a65 req-ca157744-dfc5-4fb1-b9bc-d282416dc98e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:43.027507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-59fa505c-0b7e-409c-bc62-f83410882a65 req-ca157744-dfc5-4fb1-b9bc-d282416dc98e service nova] Creating event network-vif-plugged:42c66fed-6127-4d44-b2b2-1f1ddaf5a32d for instance 153f3eef-0f34-4a4a-8738-274bcb2737ca on hv-cinder-85919 Sep 24 14:31:43.033132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-59fa505c-0b7e-409c-bc62-f83410882a65 req-ca157744-dfc5-4fb1-b9bc-d282416dc98e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031846 Sep 24 14:31:43.033964 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 265/520] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:31:43.483573 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:43.484141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:43.490157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:43.490639 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:43.491101 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:43.491780 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:43.492230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:43.492645 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:43.700625 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:43.722203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:43.724230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:43.725429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0a8dabbd-6586-4fb0-bda5-45ef16f2f84b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1745 microversion: 2.20 time: 0.249056 Sep 24 14:31:43.727435 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 256/521] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:43 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:44.753091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:44.753910 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:44.764635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:44.770745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:44.771245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:44.773717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:44.774198 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:44.777481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:45.004476 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:45.017533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:45.020549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:45.022045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-53806c40-a95e-4428-8e4d-18f862fb67e9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1745 microversion: 2.20 time: 0.274536 Sep 24 14:31:45.035959 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 266/522] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:44 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1745 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:46.051236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:46.053423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:46.067187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:46.067925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:46.070550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:46.071523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:46.072396 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:46.074840 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:46.356973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:46.373516 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:46.381162 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:46.383307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d28442c2-c311-46c6-b4e5-9e7c9c514dea tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.337226 Sep 24 14:31:46.395487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 257/523] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:46 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:47.421426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:47.423247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:47.433243 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:47.441378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:47.442081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:47.443120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:47.443740 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:47.444411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:47.739428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:47.764928 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:47.771162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:47.774213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-11728aac-21eb-4ca5-aa86-778e67f86eaa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.355481 Sep 24 14:31:47.803797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 267/524] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:47 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:48.779870 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-399636852", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:48.812371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:48.813566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:48.830172 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:48.830602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:48.833234 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:48.835378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:48.837376 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:48.837839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:48.925066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] validate_networks() for None {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:31:49.125198 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:49.134655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:49.146872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:49.148141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4a25368a-4baa-4e8e-a318-1ddd6ad73667 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.342607 Sep 24 14:31:49.153137 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 268/525] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:48 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:31:49.801974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:31:49.803182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:31:49.803898 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:31:49.804644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:31:49.805438 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:31:49.820305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:49.824763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:49.825489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:49.830513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:49.832883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:49.833475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:49.860521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Getting quotas for project 119aafe09e994b0fb512e139c894c5e7. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:31:49.865395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Getting quotas for user a15c0b58b74a476da6723e5478415be3 and project 119aafe09e994b0fb512e139c894c5e7. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:31:49.878485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:31:49.881195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:31:49.941360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8d9d4a2c-dafe-42f8-9b16-1df8fa54f1c5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165260 Sep 24 14:31:49.942559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 258/526] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:31:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:31:49.955974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a72fd0bb-b493-4a64-b7fc-752f3e4cae20 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:49.957521 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a72fd0bb-b493-4a64-b7fc-752f3e4cae20 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:50.092909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a72fd0bb-b493-4a64-b7fc-752f3e4cae20 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:50.100873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a72fd0bb-b493-4a64-b7fc-752f3e4cae20 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1214 microversion: 2.1 time: 0.150276 Sep 24 14:31:50.101424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 269/527] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:49 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:50.182709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:50.183708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:50.185956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:50.209258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:50.210073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:50.213450 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:50.220764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:50.221722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:50.222695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:50.464593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:50.483316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:50.487931 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:50.489145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-558f104a-2764-4d8a-b780-31f3ab02f380 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.312838 Sep 24 14:31:50.492510 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 259/528] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:50 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:51.125312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:51.126607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:51.152616 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:51.154952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:51.157300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:51.158250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:51.160117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:51.160902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:51.290838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:51.315469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d99444c2-8e11-4100-9754-33fe72237f28 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1218 microversion: 2.1 time: 0.194699 Sep 24 14:31:51.322038 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 270/529] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:51 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:51.520908 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:51.521521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:51.534416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:51.535807 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:51.543126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:51.543932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:51.544479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:51.544907 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:51.915505 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:51.937090 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:51.948057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:51.949475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-74737833-010a-4748-be37-7224234f249c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.432359 Sep 24 14:31:51.950402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 260/530] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:51 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:31:52.345269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:52.345870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:52.364911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:52.365497 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:52.365952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:52.366694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:52.376312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:52.377265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:52.709878 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:52.724210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-90516fa0-b3f8-447c-bc06-6fd7ddc39242 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1274 microversion: 2.1 time: 0.381547 Sep 24 14:31:52.726436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 271/531] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:52 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1274 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:52.982330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:52.983716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:53.005511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:53.007371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:53.008001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:53.008965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:53.012332 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:53.015096 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:53.405700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:53.414464 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:53.417197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:53.419195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-61a77c00-ed27-4b27-bbce-6895b1646776 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.441153 Sep 24 14:31:53.431916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 261/532] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:52 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:53.748679 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:53.750048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:53.757933 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:53.765642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:53.767053 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:53.767994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:53.768620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:53.769217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:54.022003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:54.032899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4c31b107-5518-476f-8832-698aa5359108 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1272 microversion: 2.1 time: 0.288982 Sep 24 14:31:54.034658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 272/533] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:53 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:54.448774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:54.450245 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:54.464180 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:54.464708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:54.465135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:54.465851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:54.466309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:54.468353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:54.767515 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:54.782599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:54.784111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:54.785350 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f944db24-154b-4490-b768-04481f916416 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.340891 Sep 24 14:31:54.785888 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 262/534] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:54 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:55.065170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:55.065814 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:55.078527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=34 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:55.081562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:55.088156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:55.089416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:55.094668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:55.098717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:55.099203 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:55.512686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:55.529028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8b649ec5-852a-4275-833c-16e01d62e2d8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.468484 Sep 24 14:31:55.539252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 273/535] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:55 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:55.813709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:55.815285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:55.831141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:55.840531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:55.841009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:55.841748 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:55.842200 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:55.842619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:56.099316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:56.112135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:56.117759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:56.119532 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-26e2e60d-dd4a-4898-aba7-10d6b57c231c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.309765 Sep 24 14:31:56.124759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 263/536] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:55 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:56.557514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:56.558869 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:56.572300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:56.575064 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:56.575510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:56.579419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:56.580397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:56.581337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:56.885598 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-94581b06-772d-4ed9-9319-c8b470f8efab req-aa5fc99e-2623-4457-b01c-3ede81670bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6840ef33-e118-443d-a97c-235fdaeef563", "tag": "1c30dcf5-0ad6-483c-ae52-7d75bc297429"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:31:56.903292 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-94581b06-772d-4ed9-9319-c8b470f8efab req-aa5fc99e-2623-4457-b01c-3ede81670bcf service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:56.908624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-94581b06-772d-4ed9-9319-c8b470f8efab req-aa5fc99e-2623-4457-b01c-3ede81670bcf service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:56.909344 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-94581b06-772d-4ed9-9319-c8b470f8efab req-aa5fc99e-2623-4457-b01c-3ede81670bcf service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:56.936417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-94581b06-772d-4ed9-9319-c8b470f8efab req-aa5fc99e-2623-4457-b01c-3ede81670bcf service nova] Creating event network-changed:1c30dcf5-0ad6-483c-ae52-7d75bc297429 for instance 6840ef33-e118-443d-a97c-235fdaeef563 on hv-cinder-85919 Sep 24 14:31:56.965071 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-94581b06-772d-4ed9-9319-c8b470f8efab req-aa5fc99e-2623-4457-b01c-3ede81670bcf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.399790 Sep 24 14:31:56.966608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 264/537] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:31:56.993207 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:57.007501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1683fa24-e2ee-42ee-a2d9-3668a06bde14 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.453814 Sep 24 14:31:57.016397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 274/538] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:56 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:57.159924 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:57.160634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:57.195115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:57.195618 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:57.196078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:57.196769 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:57.197225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:57.197649 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:57.560724 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:57.583512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:57.583512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:57.584272 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4a3516c6-ad23-461c-810a-c51e5c55338a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.429577 Sep 24 14:31:57.598839 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 265/539] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:57 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:58.041646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:58.041646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:58.050075 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:58.050568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:58.053716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:58.059692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:58.060355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:58.060951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:58.504083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:58.514017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ae095577-a386-4525-a7a5-9822d3165680 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.479870 Sep 24 14:31:58.525370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 275/540] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:58 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:58.617605 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:58.618209 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:58.632440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:58.633187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:58.633807 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:58.634776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:58.635412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:58.635998 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:58.879992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:58.891507 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:58.893313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:58.894765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-10c7f0a4-56ce-4b97-aa32-821f5cee4b44 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.281144 Sep 24 14:31:58.895646 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 266/541] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:58 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:31:59.537620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:59.538982 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:59.545857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:59.546193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:59.546624 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:59.548030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:59.548313 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:59.548727 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:59.736705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:31:59.745105 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ea1bd1d5-8ea3-4646-9695-bf15310aed56 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.211431 Sep 24 14:31:59.746312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 276/542] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:31:59 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:31:59.929472 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:31:59.930104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:31:59.932733 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:59.933411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:59.940061 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:59.940708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:59.941556 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:31:59.942657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:31:59.943154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:31:59.943587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:00.131188 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:00.140369 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:00.141954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:00.143178 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-707cd0c2-16b5-4eb9-9221-386b1af5acc3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.217710 Sep 24 14:32:00.150002 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 267/543] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:31:59 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:00.769325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:00.770051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:00.771999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:00.781757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:00.784066 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:00.786798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:00.788129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:00.788747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:00.789333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:01.084708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:01.100107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a6170eee-a01d-46d2-b3d1-681a9c09c3e4 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.335274 Sep 24 14:32:01.101638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 277/544] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:00 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:01.173016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:01.174403 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:01.184309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:01.185105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:01.185699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:01.186579 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:01.188390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:01.192587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:01.411202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:01.422544 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:01.424145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:01.426390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-501d2cfc-553c-4b94-bd7f-c230970739df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.259999 Sep 24 14:32:01.427169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 268/545] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:01 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:02.124416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:02.125931 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:02.136254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:02.136747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:02.137178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:02.138210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:02.138691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:02.139261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:02.305178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:02.316219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a73a9aed-c008-4332-8175-ec9838d009a8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.195487 Sep 24 14:32:02.317652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 278/546] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:02 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:02.452659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:02.453434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:02.462536 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:02.463075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:02.463504 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:02.464190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:02.464631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:02.465218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:02.607959 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:02.619026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:02.620463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:02.621640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-28ebbe4d-7c6a-434b-b511-a1b5b3cc31a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1740 microversion: 2.20 time: 0.172908 Sep 24 14:32:02.622342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 269/547] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:02 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:03.342517 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:03.344558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:03.357813 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:03.358310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:03.358753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:03.359492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:03.359944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:03.360373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:03.543473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:03.552098 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5be439e0-fc60-49b5-8f1a-a7e0d270b34e tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.215551 Sep 24 14:32:03.553216 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 279/548] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:03 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:03.652310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:03.652936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:03.659829 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:03.660310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:03.660737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:03.661425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:03.661867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:03.662279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:03.788958 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d0dc2a59-20f9-4953-8e2f-0f0f5d6827c5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Action: 'create', calling method: .version_select at 0x7f222ad3c4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-77490988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILN7rKPmwx5wydvolNy21IYBwB0hSwsCWFbFT2v4SibVo7A0gcpgNQQwvJ83YkhlCi5rcKjWVs5AzAirUcWELFhMyyuRDmEOHttdiqJBD4V4KcNcMOVHpzeR6YScIUTlA=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:03.803267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:03.804270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-d0dc2a59-20f9-4953-8e2f-0f0f5d6827c5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Getting quotas for project 8830800be89540929716703bdbb07b13. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:32:03.808167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-d0dc2a59-20f9-4953-8e2f-0f0f5d6827c5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Getting quotas for user 27724ba162164bbb8faae54388ff11d4 and project 8830800be89540929716703bdbb07b13. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:32:03.811247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:03.813270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:03.814408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4f2b6b6d-1f01-42a4-88ca-e4ab9ceb9533 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1722 microversion: 2.20 time: 0.166709 Sep 24 14:32:03.814986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 270/549] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:03 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:03.837766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d0dc2a59-20f9-4953-8e2f-0f0f5d6827c5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.052653 Sep 24 14:32:03.838355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 280/550] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:32:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:32:03.887522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1463616081", "imageRef": "e53fa242-de06-4001-b4af-2566de97e2d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-77490988", "networks": [{"uuid": "7923ceef-7faf-4f7b-a32e-f1f06464878c"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:03.939116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] validate_networks() for [('7923ceef-7faf-4f7b-a32e-f1f06464878c', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:32:04.357496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:32:04.357914 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:32:04.358381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:32:04.358785 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:32:04.359219 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:32:04.368648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:04.369125 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:04.369551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:04.370261 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:04.370707 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:04.371150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:04.378089 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:04.389304 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Getting quotas for project 8830800be89540929716703bdbb07b13. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:32:04.393199 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Getting quotas for user 27724ba162164bbb8faae54388ff11d4 and project 8830800be89540929716703bdbb07b13. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:32:04.404214 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:32:04.407661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e53fa242-de06-4001-b4af-2566de97e2d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:32:04.454052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fb4b7a2b-550c-446e-a104-0557f51547aa tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570285 Sep 24 14:32:04.454687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 271/551] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:32:04.466215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4b48a556-4500-4b40-a77f-d33e78efec6f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:04.466987 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4b48a556-4500-4b40-a77f-d33e78efec6f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:04.519167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4b48a556-4500-4b40-a77f-d33e78efec6f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:04.526424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4b48a556-4500-4b40-a77f-d33e78efec6f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1257 microversion: 2.1 time: 0.064626 Sep 24 14:32:04.527189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 281/552] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:04 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1257 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:04.575550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:04.576229 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:04.582952 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:04.583412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:04.583850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:04.584546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:04.584977 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:04.585402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:04.742262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:04.750282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1b120638-3793-4ac5-815d-dff4cbdba643 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.178756 Sep 24 14:32:04.751244 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 272/553] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:04 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:04.842627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:04.843364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:04.850973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:04.851538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:04.852046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:04.852839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:04.853526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:04.854137 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:04.981526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:04.994032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:04.995500 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:04.996695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-79358f3f-585c-4b7b-8ce8-23b74262ce77 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1722 microversion: 2.20 time: 0.159562 Sep 24 14:32:04.997246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 282/554] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:04 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:05.550015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:05.550528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:05.556401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:05.556875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:05.557303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:05.557973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:05.558419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:05.558852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:05.616645 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:05.624095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-616b8008-0db7-4e86-b9b8-93d04b12fc46 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1261 microversion: 2.1 time: 0.078531 Sep 24 14:32:05.625513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 273/555] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:05 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:05.773472 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:05.774059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:05.781357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:05.781837 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:05.782266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:05.782982 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:05.783443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:05.783848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:05.913099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:05.920802 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f44be473-1f78-4f21-9e9b-80d88f849b5d tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.151194 Sep 24 14:32:05.921364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 283/556] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:05 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:06.025251 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:06.025868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:06.033119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:06.033600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:06.034036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:06.034721 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:06.035202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:06.035629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:06.161832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:06.169823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:06.171292 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:06.172924 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2c0bb9f5-781e-479c-956a-7d46ccd5a94e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1722 microversion: 2.20 time: 0.151689 Sep 24 14:32:06.173479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 274/557] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:06 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:06.647517 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:06.648290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:06.655519 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:06.656500 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:06.656930 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:06.657625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:06.658075 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:06.658492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:06.674723 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:06.738278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:06.746080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3f5c29c9-c13c-4c57-919b-b5a360943fdb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1261 microversion: 2.1 time: 0.102656 Sep 24 14:32:06.750330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 284/558] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:06 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:06.944447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:06.945650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:06.951812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:06.952302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:06.953314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:06.954053 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:06.954505 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:06.954949 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:07.091725 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:07.100054 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-12a58cb4-2726-4bde-b16e-4f0d197024c9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.160179 Sep 24 14:32:07.100616 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 275/559] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:06 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:07.198756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:07.199417 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:07.206249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:07.206721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:07.207176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:07.207845 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:07.208297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:07.208707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:07.336295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:07.344363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:07.345808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:07.346991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7f7d2392-5225-4d8e-b6ee-987c15886b1f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1722 microversion: 2.20 time: 0.152128 Sep 24 14:32:07.347551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 285/560] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:07 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:07.768812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:07.769408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:07.775577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:07.776047 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:07.776502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:07.777172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:07.777614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:07.778027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:07.838049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:07.845619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5df8c422-57cd-4b40-b6fd-6efe6e4cbd7b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1317 microversion: 2.1 time: 0.080711 Sep 24 14:32:07.846171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 276/561] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:07 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1317 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:08.124013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:08.126406 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:08.132317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:08.132790 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:08.133215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:08.133886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:08.134330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:08.134745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:08.263283 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:08.270829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4566496e-f14b-4210-92bc-ec979df87c35 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.150638 Sep 24 14:32:08.271397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 286/562] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:08 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:08.371804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:08.372480 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:08.379292 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:08.379774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:08.380201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:08.380885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:08.381326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:08.381736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:08.516849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:08.524925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:08.526313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:08.527486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b9bf2a42-9235-4b9d-9752-e07c2d347f55 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1722 microversion: 2.20 time: 0.159668 Sep 24 14:32:08.528037 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 277/563] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:08 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:08.664412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-20cbb489-4fa2-453e-a086-d30ca8fa35d9 req-56ba89c1-38c6-4a2e-a773-bc600c267ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153f3eef-0f34-4a4a-8738-274bcb2737ca", "name": "network-vif-unplugged", "status": "completed", "tag": "42c66fed-6127-4d44-b2b2-1f1ddaf5a32d"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:08.673564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-20cbb489-4fa2-453e-a086-d30ca8fa35d9 req-56ba89c1-38c6-4a2e-a773-bc600c267ca1 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:08.674042 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-20cbb489-4fa2-453e-a086-d30ca8fa35d9 req-56ba89c1-38c6-4a2e-a773-bc600c267ca1 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:08.674467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-20cbb489-4fa2-453e-a086-d30ca8fa35d9 req-56ba89c1-38c6-4a2e-a773-bc600c267ca1 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:08.685464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-20cbb489-4fa2-453e-a086-d30ca8fa35d9 req-56ba89c1-38c6-4a2e-a773-bc600c267ca1 service nova] Creating event network-vif-unplugged:42c66fed-6127-4d44-b2b2-1f1ddaf5a32d for instance 153f3eef-0f34-4a4a-8738-274bcb2737ca on hv-cinder-85919 Sep 24 14:32:08.690354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-20cbb489-4fa2-453e-a086-d30ca8fa35d9 req-56ba89c1-38c6-4a2e-a773-bc600c267ca1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090228 Sep 24 14:32:08.691005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 287/564] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:32:08.869024 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:08.869632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:08.876031 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:08.876523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:08.877016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:08.877817 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:08.878390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:08.878788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:08.942417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:08.950000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8d85f01e-7492-4bb3-a435-487d4434f1cc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1315 microversion: 2.1 time: 0.084832 Sep 24 14:32:08.950561 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 278/565] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:08 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1315 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:09.295291 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:09.295992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:09.316776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.317278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.317714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:09.318434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.318911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.319334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:09.554336 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:09.555005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:09.564621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.567673 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.568287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:09.569654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.571493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.573061 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:09.707219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:09.720417 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a2bc224f-127a-494b-913c-61e7b4d334b9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.430165 Sep 24 14:32:09.720947 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 288/566] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:09 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:09.765076 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:09.793237 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:09.795550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:09.798148 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-563c0756-8962-4653-9f81-fe0e4cdbf331 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1725 microversion: 2.20 time: 0.247800 Sep 24 14:32:09.800231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 279/567] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:09 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:09.834044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5811766-065a-4b09-bd00-a4d473184487"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:09.838693 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:09.848625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.849116 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.849779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:09.850658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.851292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.851884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:09.981413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:09.982034 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:09.989650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.990479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.991134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:09.992005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:09.992610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:09.993355 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.200278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:10.210172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f495c601-652e-4295-82a6-e771bb169640 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.240083 Sep 24 14:32:10.210862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 280/568] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:09 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:10.227742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c4be8eef-a220-4186-81ef-73d0229f8aa0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.398493 Sep 24 14:32:10.228342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 289/569] 10.222.0.52 () {62 vars in 1364 bytes} [Sat Sep 24 14:32:09 2022] POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments => generated 188 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:32:10.359635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:10.360245 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:10.366369 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:10.366900 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:10.367334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.368039 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:10.368494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:10.368921 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.413680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120743) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 14:32:10.491804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ab13ae96-3075-43d0-8497-d8136f022a90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/action" status: 202 len: 0 microversion: 2.20 time: 0.136011 Sep 24 14:32:10.492993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 281/570] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 14:32:10 2022] POST /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:32:10.501031 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:10.502260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:10.511268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:10.512001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:10.512668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.513604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:10.514258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:10.515557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.675576 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:10.684577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:10.687636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:10.689171 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-00918892-b476-470c-b840-473361dc8fda tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.192122 Sep 24 14:32:10.690380 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 290/571] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:10 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:10.747980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:10.749226 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:10.761157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:10.765035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:10.765640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.770899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:10.772192 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:10.772936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.857427 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-cb024b20-999c-4be2-b42a-8c9eff39b049 req-5c7665e0-17f1-4a5d-a75e-9bd57ba9c3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6840ef33-e118-443d-a97c-235fdaeef563", "name": "network-vif-plugged", "status": "completed", "tag": "1c30dcf5-0ad6-483c-ae52-7d75bc297429"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:10.876867 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-cb024b20-999c-4be2-b42a-8c9eff39b049 req-5c7665e0-17f1-4a5d-a75e-9bd57ba9c3fd service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:10.881410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-cb024b20-999c-4be2-b42a-8c9eff39b049 req-5c7665e0-17f1-4a5d-a75e-9bd57ba9c3fd service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:10.881913 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-cb024b20-999c-4be2-b42a-8c9eff39b049 req-5c7665e0-17f1-4a5d-a75e-9bd57ba9c3fd service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:10.906618 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-cb024b20-999c-4be2-b42a-8c9eff39b049 req-5c7665e0-17f1-4a5d-a75e-9bd57ba9c3fd service nova] Creating event network-vif-plugged:1c30dcf5-0ad6-483c-ae52-7d75bc297429 for instance 6840ef33-e118-443d-a97c-235fdaeef563 on hv-cinder-85919 Sep 24 14:32:10.940046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-cb024b20-999c-4be2-b42a-8c9eff39b049 req-5c7665e0-17f1-4a5d-a75e-9bd57ba9c3fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088333 Sep 24 14:32:10.943348 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 291/572] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:32:10.967655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:10.983748 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cc0e535a-5044-4d48-9ff0-8fa1a85d206a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.242010 Sep 24 14:32:10.984340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 282/573] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:10 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:11.233942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:11.234637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:11.240795 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:11.241274 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:11.241706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:11.242385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:11.242851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:11.243273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:11.400790 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:11.409881 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-99d0c077-fcea-4e75-9593-051e81e6e7e9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.180019 Sep 24 14:32:11.411005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 292/574] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:11 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:11.714860 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:11.715463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:11.721897 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:11.722370 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:11.722795 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:11.723627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:11.724072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:11.724486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:11.858570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:11.869277 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:11.871000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:11.872561 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1321c534-4154-47d3-8310-64eb25003d50 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.161646 Sep 24 14:32:11.873456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 283/575] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:11 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:12.007913 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:12.009103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:12.023738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:12.024327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:12.024778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:12.025578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:12.026040 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:12.026529 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:12.165914 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:12.174018 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-bd46f8a4-5829-4012-8676-1256edd3ec8c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.170023 Sep 24 14:32:12.174569 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 293/576] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:12 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:12.433468 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:12.434072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:12.440641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:12.441132 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:12.441563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:12.442252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:12.442750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:12.443152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:12.581370 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:12.590238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-653fc493-9f32-4638-99d0-17e2ecec4beb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.160500 Sep 24 14:32:12.590806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 284/577] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:12 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:12.897480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:12.898144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:12.904141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:12.904614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:12.905297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:12.906619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:12.907102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:12.907525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:13.053424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:13.062595 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:13.064068 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:13.065236 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fe14db84-d8b8-40e8-9f62-e580bf7f5dcc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.171694 Sep 24 14:32:13.065787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 294/578] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:12 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:13.199603 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:13.200947 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:13.208799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:13.209411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:13.209906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:13.210668 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:13.211224 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:13.211849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:13.392193 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:13.400598 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a86db7a0-4930-4bcb-b122-253311591a5a tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.205110 Sep 24 14:32:13.401196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 285/579] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:13 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:13.612886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:13.613602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:13.620023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:13.620501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:13.620932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:13.621620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:13.622064 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:13.622483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:13.754255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:13.762338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8a515b17-362d-4cfd-bf77-b03ec769b999 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.153837 Sep 24 14:32:13.763020 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 295/580] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:13 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:14.091151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:14.091754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:14.097717 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:14.098198 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:14.098633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:14.099337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:14.099788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:14.100211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:14.232189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:14.249784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:14.251264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:14.252436 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-34221cee-6577-4000-bb68-2bbcba411e4f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.165175 Sep 24 14:32:14.253018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 286/581] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:14 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:14.423986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:14.424592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:14.431069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:14.431492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:14.431919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:14.432670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:14.433117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:14.433534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:14.523767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:14.594545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:14.602768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f1cfc11e-9840-425e-9fa7-ca7dd9c24f1b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.183161 Sep 24 14:32:14.603375 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 296/582] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:14 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:14.793889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:14.794410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:14.797318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:14.798397 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:14.804527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:14.804907 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:14.805311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:14.806209 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:14.806661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:14.807134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:14.829748 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:14.951546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:14.959382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-65960a0f-49d8-450a-b057-5a1e0e3f1db7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.176703 Sep 24 14:32:14.959967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 287/583] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:14 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:15.279689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:15.281183 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:15.287192 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:15.287672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:15.288101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:15.288796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:15.289265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:15.289646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:15.420628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:15.429959 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:15.431483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:15.432629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8689e687-a06c-4062-b667-0908974e9325 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.157043 Sep 24 14:32:15.433186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 297/584] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:15 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:15.627120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:15.627789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:15.634426 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:15.634933 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:15.635375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:15.636072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:15.636525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:15.636945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:15.774016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:15.783872 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-909a4e0d-900e-456a-adf3-a6c1a7fa1355 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.161867 Sep 24 14:32:15.784819 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 288/585] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:15 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:15.982638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:15.984167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:15.990440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:15.990950 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:15.991378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:15.992077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:15.992526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:15.992936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:16.130640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:16.138694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-110018d7-d24a-4f97-b225-45ed2ae94f8f tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.159858 Sep 24 14:32:16.139554 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 298/586] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:15 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:16.459827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:16.461331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:16.468843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:16.469415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:16.469916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:16.471058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:16.471693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:16.472199 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:16.610296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:16.619130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:16.620692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:16.621927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-33f3304b-dc5c-40df-8ea2-64043de4d33e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.165999 Sep 24 14:32:16.622735 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 289/587] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:16 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:16.806453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:16.807103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:16.813463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:16.813942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:16.814373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:16.815099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:16.815555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:16.815974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:16.952729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:16.955004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:16.962252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-273ecc24-b8c7-432b-9667-996c1e7e4445 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.159685 Sep 24 14:32:16.963069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 299/588] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:16 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:17.162311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:17.163144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:17.170127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:17.170727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:17.171865 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:17.172642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:17.173159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:17.173651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:17.323395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:17.331167 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-58986619-ce02-4611-8efc-79e35af4c817 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.172762 Sep 24 14:32:17.331745 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 290/589] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:17 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:17.647143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:17.647744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:17.656293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:17.656774 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:17.657196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:17.657866 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:17.658307 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:17.658722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:17.799244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:17.808693 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:17.810237 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:17.811452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-49128f1e-bbae-4973-a962-f139d3cded20 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.168230 Sep 24 14:32:17.824005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 300/590] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:17 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:17.987385 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:17.988036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:17.995373 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:17.995982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:17.996515 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:17.997288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:17.997809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:17.998309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:18.130670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:18.138974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7a6d4ac7-bc5f-429a-9d6c-7b3bed33d759 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.156344 Sep 24 14:32:18.140146 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 291/591] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:17 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:18.354339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:18.354874 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:18.361203 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:18.361676 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:18.362107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:18.362779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:18.363245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:18.363868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:18.502275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:18.509883 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d1f63206-6888-4bc8-93a3-3be12a42b7f7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.159514 Sep 24 14:32:18.510793 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 301/592] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:18 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:18.838029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:18.838697 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:18.845483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:18.845977 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:18.846410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:18.847309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:18.847779 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:18.848202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:18.987893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:18.997061 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:18.998644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:19.000063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2c2ec529-272d-43b9-93d1-a958af262df5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.166354 Sep 24 14:32:19.008131 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 292/593] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:18 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:19.162443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:19.163176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:19.169066 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:19.169546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:19.170012 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:19.170726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:19.171245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:19.171698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:19.306747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:19.314914 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5d9cacf4-60af-4874-86e3-8bf23e655158 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.156255 Sep 24 14:32:19.315468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 302/594] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:19 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:19.532938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:19.533570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:19.539490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:19.539968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:19.540398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:19.541071 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:19.541513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:19.541935 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:19.672262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:19.679842 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-21178662-1f1b-43e6-8d07-52bdc6f031e8 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.150996 Sep 24 14:32:19.680330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 293/595] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:19 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:20.026078 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:20.027002 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:20.033319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:20.033806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:20.034245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:20.034961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:20.035417 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:20.035841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:20.163139 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:20.171584 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:20.173006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:20.174133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1b9a0d6a-0428-4d1d-ba93-c6c8ab488530 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.152063 Sep 24 14:32:20.174687 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 303/596] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:20 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:20.339807 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:20.340766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:20.343228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:20.348884 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:20.349368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:20.349834 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:20.350535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:20.351027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:20.351448 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:20.476805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:20.484831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-91d5779e-26ef-40c2-9c22-9551f5baebb6 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.149513 Sep 24 14:32:20.485379 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 294/597] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:20 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:20.703792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:20.704410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:20.710283 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:20.710764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:20.711233 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:20.711912 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:20.712371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:20.712796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:20.847114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:20.856722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cc37e4af-6905-404d-9e3f-2e3fdd1e9010 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.157306 Sep 24 14:32:20.857310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 304/598] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:20 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:21.202685 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:21.203333 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:21.209343 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:21.209820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:21.210273 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:21.210983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:21.211424 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:21.211837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:21.342869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:21.352083 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:21.353504 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:21.354657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-33be0115-0623-4afe-81af-748022952909 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.155922 Sep 24 14:32:21.355243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 295/599] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:21 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:21.507640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:21.508251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:21.514713 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:21.515252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:21.515685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:21.516394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:21.516847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:21.517293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:21.643493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:21.653459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-35088e57-41ad-40e3-896f-101f786ab450 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.149653 Sep 24 14:32:21.654044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 305/600] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:21 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:21.879738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:21.880279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:21.886330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:21.886825 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:21.887266 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:21.887940 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:21.888392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:21.888810 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:22.013693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:22.021774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de954b00-efc7-4a03-9c59-ca896c5c1df5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.146058 Sep 24 14:32:22.022323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 296/601] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:21 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:22.381029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:22.381916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:22.388425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:22.388912 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:22.389349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:22.390655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:22.391173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:22.391595 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:22.521091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:22.529485 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:22.531294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:22.532432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-11888471-6213-4c18-8fb9-69e7df02c70e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1811 microversion: 2.20 time: 0.155356 Sep 24 14:32:22.533049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 306/602] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:22 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:22.678203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:22.678730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:22.685050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:22.685531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:22.685958 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:22.687254 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:22.687699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:22.688113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:22.818251 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:22.827592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b8b7c2ef-840e-432e-b3e3-f8de70302bd9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.153272 Sep 24 14:32:22.828318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 297/603] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:22 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:23.045257 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:23.046380 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:23.052230 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:23.052725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:23.053156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:23.053835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:23.054284 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:23.054703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:23.284213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:23.301196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-383b0b5c-c6e9-4453-b311-c623d8a4f184 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.259778 Sep 24 14:32:23.311795 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 307/604] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:23 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:23.558083 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:23.558990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:23.565349 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:23.565839 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:23.566269 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:23.566990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:23.567438 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:23.567854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:23.708340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:23.719145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:23.721052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:23.722209 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-844afc76-b375-45c8-86ba-6ad7ac4d4237 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1753 microversion: 2.20 time: 0.168411 Sep 24 14:32:23.722967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 298/605] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:23 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:23.850598 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:23.851322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:23.857775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:23.858847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:23.859008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-10917950-6505-49ad-ab69-2a7908ef265b req-420bd983-b80b-48d8-a482-65802bf1f392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb8da2f-7b74-42db-a52b-fe358b040633", "tag": "b51d80e5-325c-440f-824b-228eda3d320a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:23.859298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:23.859992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:23.860442 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:23.860864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:23.868100 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-10917950-6505-49ad-ab69-2a7908ef265b req-420bd983-b80b-48d8-a482-65802bf1f392 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:23.868575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-10917950-6505-49ad-ab69-2a7908ef265b req-420bd983-b80b-48d8-a482-65802bf1f392 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:23.869010 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-10917950-6505-49ad-ab69-2a7908ef265b req-420bd983-b80b-48d8-a482-65802bf1f392 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:23.882297 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-10917950-6505-49ad-ab69-2a7908ef265b req-420bd983-b80b-48d8-a482-65802bf1f392 service nova] Creating event network-changed:b51d80e5-325c-440f-824b-228eda3d320a for instance fdb8da2f-7b74-42db-a52b-fe358b040633 on hv-cinder-85919 Sep 24 14:32:23.887425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-10917950-6505-49ad-ab69-2a7908ef265b req-420bd983-b80b-48d8-a482-65802bf1f392 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033118 Sep 24 14:32:23.888058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 299/606] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:32:24.001728 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:24.009434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6c4737fc-e5c2-4853-ac77-48747695aea5 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.162856 Sep 24 14:32:24.010000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 308/607] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:23 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:24.335774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:24.336423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:24.342487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:24.343001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:24.343436 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:24.344111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:24.344559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:24.344985 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:24.472916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:24.480476 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-af3e9357-70db-46af-95ce-a34a856d2784 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.149053 Sep 24 14:32:24.481027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 300/608] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:24 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:24.748607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:24.749729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:24.755650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:24.756134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:24.756566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:24.757256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:24.757730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:24.758152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:25.032604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:25.034030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:25.040702 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:25.041270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:25.041763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:25.042538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:25.043135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:25.043624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:25.049583 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:25.060955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:25.063782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:25.065255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-59920d45-54a2-4f84-8698-13e47e4a372f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1753 microversion: 2.20 time: 0.320443 Sep 24 14:32:25.066120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 309/609] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:24 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1753 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:25.191205 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:25.198743 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eadd40ce-ded5-4fb1-98d0-c2ecfb01cce7 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1314 microversion: 2.1 time: 0.170426 Sep 24 14:32:25.199328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 301/610] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:25 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:25.503196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:25.503722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:25.505554 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:25.510784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:25.511296 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:25.511729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:25.512412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:25.512862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:25.513312 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:25.788245 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:25.796749 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fc2ee10d-0fd1-4cb8-a7ba-30264930271c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.298022 Sep 24 14:32:25.797412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 310/611] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:25 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:26.091529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:26.092144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:26.099194 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.099690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.100123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.100809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.101263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.101687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.223568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:26.224606 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:26.231716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.232204 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.232637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.234146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.234619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.235068 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.239171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:26.247804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:26.249250 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:26.250411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-132409a7-f067-42f0-ad91-17121f3022f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.162972 Sep 24 14:32:26.250989 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 302/612] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:26 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:26.363736 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:26.371432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6749a513-d108-4ae4-843e-0a2b676be989 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1464 microversion: 2.1 time: 0.153729 Sep 24 14:32:26.371999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 311/613] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:26 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:26.420750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:26.421235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:26.427011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.427485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.427915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.428598 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.429045 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.429459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.453751 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:32:26.484852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:26.536031 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3afbfbb2-9d7a-4862-9fd7-d25d3038d33c tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 204 len: 0 microversion: 2.1 time: 0.118801 Sep 24 14:32:26.536625 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 303/614] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:32:26 2022] DELETE /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:32:26.544916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:26.545372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:26.551391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.551935 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.552417 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.553180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.553632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.554669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.688517 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:26.696118 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-dea6472e-0aba-4c62-96d0-bad355268878 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1470 microversion: 2.1 time: 0.155247 Sep 24 14:32:26.696664 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 312/615] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:26 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:26.823615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:26.824310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:26.831025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.831518 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.831947 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.832627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:26.833078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:26.833498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:26.958865 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:26.966719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-54f149b6-24cd-42ef-a9e2-df32963480eb tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.147369 Sep 24 14:32:26.967571 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 304/616] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:26 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:27.275812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:27.276351 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:27.283706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:27.284187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:27.284623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:27.285305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:27.285756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:27.286179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:27.409593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:27.418014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:27.419477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:27.420624 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-03b0791b-48c9-4748-ab7a-70368f423acd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.148781 Sep 24 14:32:27.421169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 313/617] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:27 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:32:27.719895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:27.720616 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:27.726939 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:27.727417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:27.727853 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:27.728525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:27.728979 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:27.729392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:27.871683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:27.880069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dc9e81e0-0887-4072-b4a9-517a25912d8b tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1470 microversion: 2.1 time: 0.164030 Sep 24 14:32:27.880618 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 305/618] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:27 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:27.989787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:27.990347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:27.996512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:27.997040 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:27.997511 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:27.998215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:27.998708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:27.999180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:28.132869 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:28.140386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b3890a98-e765-410c-a6ad-b426413e60d5 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.154659 Sep 24 14:32:28.140941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 314/619] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:27 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:28.447123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:28.447736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:28.453573 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:28.454046 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:28.454474 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:28.455171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:28.455620 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:28.456036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:28.590267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:28.599497 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:28.600965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:28.602114 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-351b56cd-866b-48cc-808b-e83a7d2f1106 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.158996 Sep 24 14:32:28.602666 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 306/620] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:28 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:28.902526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:28.903157 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:28.910395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:28.910898 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:28.911323 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:28.911998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:28.912438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:28.912849 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:29.036488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:29.044240 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1b4e5862-7bbc-416a-82f3-17f29354b9da tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1470 microversion: 2.1 time: 0.145541 Sep 24 14:32:29.044801 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 315/621] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:28 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:29.162722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:29.163360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:29.169637 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:29.170111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:29.170534 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:29.171239 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:29.171681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:29.172093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:29.303686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:29.311341 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4d8752f7-5578-4f84-8330-babe42d144cd tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.152399 Sep 24 14:32:29.311895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 307/622] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:29 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:29.367440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb7239a0-dfcf-4c7c-9bbf-1ffb1c4ee3db"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:29.369826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:29.376371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:29.376852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:29.377288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:29.377970 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:29.378426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:29.378877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:29.392250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:29.628008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:29.628618 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:29.634463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:29.634983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:29.635417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:29.636099 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:29.636545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:29.636963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:29.766122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:29.774737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:29.776270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:29.777521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f6d7aee2-9b47-4e7e-ba84-a31534091afb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.154706 Sep 24 14:32:29.778076 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 308/623] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:29 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:32:30.067146 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:30.067751 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:30.073895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:30.074371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:30.074804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:30.075499 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:30.075943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:30.076360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:30.210525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:30.218086 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-575f836a-18cd-4a8d-af83-a28164c4e5f9 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1470 microversion: 2.1 time: 0.154902 Sep 24 14:32:30.218639 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 309/624] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:30 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:30.333646 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:30.334191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:30.339868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:30.340342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:30.340769 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:30.341437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:30.341901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:30.342317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:30.471029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:30.478611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ca330bdb-83ee-4795-84e1-fae874be4113 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.148697 Sep 24 14:32:30.479211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 310/625] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:30 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:30.803872 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:30.804211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:30.810759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:30.811277 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:30.811705 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:30.812975 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:30.813423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:30.813838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:30.962594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:30.971953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:30.973406 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:30.974586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7a6028bf-0473-464a-9d95-b4ff0f66a695 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.174834 Sep 24 14:32:30.975169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 311/626] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:30 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:31.060202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2d9bf421-020c-43fa-9dbf-43ac659f58f6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.794050 Sep 24 14:32:31.060792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 316/627] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:32:29 2022] POST /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments => generated 194 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:32:31.241869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:31.242558 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:31.249101 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:31.249689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:31.250276 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:31.251045 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:31.251570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:31.252061 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:31.380062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:31.387696 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f36e2e7d-8e2a-4412-a525-be581bce7c39 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1470 microversion: 2.1 time: 0.149950 Sep 24 14:32:31.388246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 312/628] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:31 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:31.501303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:31.502229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:31.514588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:31.515114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:31.515552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:31.516256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:31.516866 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:31.517489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:31.809993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:31.817703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5e26d24c-83a1-4040-aa69-be76f7bb897b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.320396 Sep 24 14:32:31.818495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 317/629] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:31 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:32.001611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:32.002136 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:32.008010 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:32.008501 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:32.008921 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:32.009660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:32.010074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:32.010489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:32.163755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:32.174216 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:32.176351 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:32.185759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-536ec8a8-be74-4d7a-8999-b48632a673c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.180881 Sep 24 14:32:32.185759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 313/630] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:31 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:32.323165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-ae29a4e4-48a1-47bc-8c4b-e9120a9319d1 req-2818f191-e724-4c55-9fad-e4eba5368228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6840ef33-e118-443d-a97c-235fdaeef563", "name": "network-vif-deleted", "tag": "1c30dcf5-0ad6-483c-ae52-7d75bc297429"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:32.327447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-ae29a4e4-48a1-47bc-8c4b-e9120a9319d1 req-2818f191-e724-4c55-9fad-e4eba5368228 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:32.327949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-ae29a4e4-48a1-47bc-8c4b-e9120a9319d1 req-2818f191-e724-4c55-9fad-e4eba5368228 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:32.328923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-ae29a4e4-48a1-47bc-8c4b-e9120a9319d1 req-2818f191-e724-4c55-9fad-e4eba5368228 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:32.341234 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-ae29a4e4-48a1-47bc-8c4b-e9120a9319d1 req-2818f191-e724-4c55-9fad-e4eba5368228 service nova] Creating event network-vif-deleted:1c30dcf5-0ad6-483c-ae52-7d75bc297429 for instance 6840ef33-e118-443d-a97c-235fdaeef563 on hv-cinder-85919 Sep 24 14:32:32.346688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-ae29a4e4-48a1-47bc-8c4b-e9120a9319d1 req-2818f191-e724-4c55-9fad-e4eba5368228 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Sep 24 14:32:32.347329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 318/631] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:32:32.411765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:32.412380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:32.419719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:32.420212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:32.420655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:32.421644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:32.422763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:32.423755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:32.491940 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:32.499545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eed80510-23ec-4b17-a5ef-53132811cb77 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1299 microversion: 2.1 time: 0.091872 Sep 24 14:32:32.500330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 314/632] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:32 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:32.845119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:32.846524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:32.857309 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:32.857803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:32.858239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:32.859462 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:32.860200 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:32.860887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:33.019983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-6591c7bf-e88e-491e-a32c-8625f458e7c7 req-d91fb17b-1e70-4cd3-8aa4-d1fa05258293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb8da2f-7b74-42db-a52b-fe358b040633", "name": "network-vif-plugged", "status": "completed", "tag": "b51d80e5-325c-440f-824b-228eda3d320a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:33.043875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6591c7bf-e88e-491e-a32c-8625f458e7c7 req-d91fb17b-1e70-4cd3-8aa4-d1fa05258293 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:33.044523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6591c7bf-e88e-491e-a32c-8625f458e7c7 req-d91fb17b-1e70-4cd3-8aa4-d1fa05258293 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:33.045119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6591c7bf-e88e-491e-a32c-8625f458e7c7 req-d91fb17b-1e70-4cd3-8aa4-d1fa05258293 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:33.085143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-6591c7bf-e88e-491e-a32c-8625f458e7c7 req-d91fb17b-1e70-4cd3-8aa4-d1fa05258293 service nova] Creating event network-vif-plugged:b51d80e5-325c-440f-824b-228eda3d320a for instance fdb8da2f-7b74-42db-a52b-fe358b040633 on hv-cinder-85919 Sep 24 14:32:33.099702 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-6591c7bf-e88e-491e-a32c-8625f458e7c7 req-d91fb17b-1e70-4cd3-8aa4-d1fa05258293 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079232 Sep 24 14:32:33.100351 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 315/633] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:32:33.157504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:33.178028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f0afcf45-5cdd-4d73-8f3a-d8025d1d62e4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.340266 Sep 24 14:32:33.179106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 319/634] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:32 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:33.209955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:33.210651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:33.224145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:33.225074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:33.225753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:33.226789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:33.227515 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:33.228182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:33.427896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:33.439998 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:33.442473 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:33.444614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-71d75ccf-40ba-4e6a-b040-3771d2438be8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.243782 Sep 24 14:32:33.445791 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 316/635] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:33 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:33.526011 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:33.527035 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:33.542265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:33.542807 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:33.544155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:33.544940 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:33.545645 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:33.546099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:33.634591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:33.635282 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:33.635818 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:33.636389 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:33.684780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:33.693564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c426ec93-60d5-419b-93e1-3404bd900ade tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.173840 Sep 24 14:32:33.694124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 320/636] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:33 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:34.204935 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:34.205546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:34.212008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:34.212490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:34.212919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:34.213599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:34.214143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:34.214672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:34.388262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:34.396583 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-17bf91a9-7fe7-45a4-b5c6-2a3b44688bae tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.195495 Sep 24 14:32:34.403496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 317/637] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:34 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:34.480578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:34.481496 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:34.489054 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:34.489609 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:34.490123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:34.490829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:34.491272 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:34.491686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:34.634286 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:34.647852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:34.649789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:34.651594 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c425a4c8-1ff9-48d7-af5f-f66862ce4b7c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.175588 Sep 24 14:32:34.652577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 321/638] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:34 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:34.717657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:34.718440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:34.725161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:34.725978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:34.726799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:34.728004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:34.728496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:34.729039 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:34.762651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:34.763179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:34.763623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:34.764063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:34.808548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:34.816362 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-aaa069a0-6d7c-44fd-861c-c2da45740128 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.102869 Sep 24 14:32:34.816925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 318/639] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:34 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:35.422118 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:35.422727 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:35.428984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:35.429472 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:35.429912 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:35.430779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:35.431449 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:35.432028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:35.570715 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:35.578960 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-48af6e76-1c88-429e-aa3a-a561693d516e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.160597 Sep 24 14:32:35.579535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 322/640] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:35 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:35.678207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:35.678757 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:35.685457 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:35.685951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:35.686425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:35.687848 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:35.688324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:35.688756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:35.829682 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:35.841766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:35.843309 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:35.843754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:35.844101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:35.844877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f6eaa2e1-9227-4ebd-b15b-ccd1bebf756b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.170719 Sep 24 14:32:35.845516 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 319/641] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:35 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:35.861544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:35.862123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:35.862625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:35.863438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:35.863888 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:35.864304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:35.897658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:35.898415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:35.898877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:35.899321 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:35.949168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:35.960008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-dcb5568c-0172-49b8-86c5-997a93ffde75 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.120702 Sep 24 14:32:35.960862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 323/642] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:35 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:36.603619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:36.604737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:36.614245 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:36.614735 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:36.615259 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:36.615963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:36.616413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:36.616830 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:36.620083 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:36.779018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:36.786972 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-56d095ff-22ca-40ac-8a94-27918abc897c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.188096 Sep 24 14:32:36.787789 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 320/643] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:36 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:36.870903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:36.871531 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:36.878499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:36.878993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:36.879421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:36.880092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:36.880533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:36.880947 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:36.987766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:36.988330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:36.995102 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:36.995594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:36.996035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:36.996727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:36.997179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:36.997672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:37.024683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:37.034244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:37.036534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:37.040672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-49b130c5-a211-4981-a3ca-cd3e9e4c7990 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.173672 Sep 24 14:32:37.045385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 324/644] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:36 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:37.053204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:37.054178 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:37.055057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:37.055970 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:37.111435 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:37.119232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2e83beb9-9c07-418c-b9ab-e42084d777c1 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.135777 Sep 24 14:32:37.119798 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 321/645] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:36 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:37.810458 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:37.811018 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:37.816998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:37.817705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:37.818285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:37.819154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:37.819740 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:37.820295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:37.959579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:37.967392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d3b0d807-79e7-4732-b8fa-297e6fa27bd1 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.161518 Sep 24 14:32:37.968394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 325/646] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:37 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:38.071150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:38.071720 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:38.080191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:38.080685 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:38.081122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:38.082022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:38.082480 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:38.082942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:38.143246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:38.144013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:38.150231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:38.150843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:38.151349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:38.152206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:38.152670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:38.153157 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:38.201676 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:38.202158 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:38.202588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:38.203923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:38.233445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:38.242589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:38.244075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:38.245599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b8854398-19ab-4e9c-b3f2-55a0dfa58592 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.178309 Sep 24 14:32:38.246485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 322/647] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:38 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:32:38.252615 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:38.272873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-88178ec1-5630-49d5-88e9-77571fd691cd tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.133693 Sep 24 14:32:38.273847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 326/648] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:38 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:38.999095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:39.000766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:39.006653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:39.007161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:39.007588 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:39.008258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:39.008707 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:39.009116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:39.150366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:39.158331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-94e4da73-d4a5-4153-8313-038cdc5d539b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.163486 Sep 24 14:32:39.158917 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 323/649] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:38 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:39.275024 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:39.276637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:39.284266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:39.284758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:39.285204 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:39.285900 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:39.286391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:39.286923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:39.303284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:39.304170 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:39.313479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:39.314000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:39.314433 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:39.315308 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:39.315761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:39.316179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:39.352945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:39.353894 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:39.354393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:39.354956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:39.405461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:39.416551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-feb875dc-2797-481c-8a08-af6b09e70d57 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.117068 Sep 24 14:32:39.417440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 324/650] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:39 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:39.448964 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:39.458643 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:39.460131 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:39.461313 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0d9e3a74-1213-460e-baf3-23296f8e538d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.192181 Sep 24 14:32:39.462186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 327/651] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:39 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:40.181701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:40.182354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:40.193682 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:40.194177 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:40.194617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:40.195378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:40.195829 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:40.196254 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:40.335280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:40.344373 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b5a57702-9384-408c-90cd-c84eee949c15 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.166443 Sep 24 14:32:40.344951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 325/652] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:40 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:40.440216 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:40.441088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:40.447372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:40.447855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:40.448297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:40.448988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:40.449442 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:40.449865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:40.481311 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:40.481796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:40.482233 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:40.482683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:40.490120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:40.491111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:40.497481 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:40.498280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:40.498766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:40.499496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:40.500120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:40.500543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:40.548734 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:40.556573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ca7a7611-6c26-45e6-b9ee-8b73563b7710 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.120154 Sep 24 14:32:40.557230 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 328/653] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:40 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:40.653610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:40.664276 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:40.665973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:40.667287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-591d6030-64b0-49eb-9941-f884e200fe67 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.180955 Sep 24 14:32:40.668007 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 326/654] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:40 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:41.367949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:41.368581 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:41.374436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:41.374935 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:41.375363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:41.376077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:41.376504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:41.376950 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:41.511467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:41.519945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c1449628-f68f-4cb9-84de-ee8b37412b60 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.156056 Sep 24 14:32:41.520539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 329/655] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:41 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:41.580768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:41.581563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:41.588253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:41.588818 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:41.589492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:41.590187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:41.590641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:41.591082 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:41.626280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:41.626690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:41.627128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:41.627582 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:41.675561 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:41.684746 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6f184fdb-a71a-4570-9094-fa1013080193 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.108827 Sep 24 14:32:41.685465 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 327/656] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:41 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:41.698858 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:41.700560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:41.713872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:41.714368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:41.714801 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:41.715529 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:41.716044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:41.716463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:41.862980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:41.872780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:41.874891 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:41.876142 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-45a199b5-969c-42da-a812-4d443e562db7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.181639 Sep 24 14:32:41.878971 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 330/657] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:41 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:42.543846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:42.544372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:42.550332 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:42.550827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:42.551274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:42.551948 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:42.552400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:42.552819 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:42.679169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:42.686629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a281cd9c-e302-4f5c-8dd0-a10e88dca3d6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.146759 Sep 24 14:32:42.687720 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 328/658] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:42 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:42.709339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:42.709943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:42.716168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:42.716643 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:42.717093 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:42.717762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:42.718228 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:42.718643 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:42.722839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:42.750804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:42.751289 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:42.751710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:42.752138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:42.791523 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:42.798978 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0dbe18f8-5b11-4898-950c-0bb5a808a8ab tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.093872 Sep 24 14:32:42.799471 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 331/659] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:42 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:42.902841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:42.903449 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:42.909524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:42.910005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:42.910435 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:42.911152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:42.911602 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:42.912021 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:43.036690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:43.045116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:43.047084 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:43.048225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-87d83afc-be69-4116-9092-1be8fae0241a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.149310 Sep 24 14:32:43.048774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 329/660] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:42 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:43.711826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:43.712433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:43.718789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:43.719297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:43.719731 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:43.720435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:43.720884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:43.721302 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:43.821538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:43.822250 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:43.828745 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:43.829613 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:43.829755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:43.830346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:43.830800 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:43.831243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:43.846483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:43.854067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b897a5ce-70e4-44f1-b9d2-bd3c4033c13e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.146149 Sep 24 14:32:43.854621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 332/661] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:43 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:43.864081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:43.864562 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:43.864994 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:43.865462 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:43.908402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:43.916068 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2745721f-bff0-4f29-82e1-377e2eafb3b8 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.098406 Sep 24 14:32:43.916633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 330/662] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:43 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:44.074646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:44.075278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:44.081113 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:44.081586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:44.082013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:44.082685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:44.083164 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:44.083580 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:44.211477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:44.220263 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:44.221683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:44.222825 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8922b75c-8961-430b-96a1-3a3dc5252684 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.152409 Sep 24 14:32:44.223380 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 333/663] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:44 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:44.876971 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:44.877579 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:44.883996 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:44.884476 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:44.884907 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:44.885584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:44.886032 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:44.886448 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:44.939226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:44.939969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:44.946480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:44.947080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:44.947603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:44.948359 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:44.948883 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:44.949373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:44.992160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:44.992642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:44.993073 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:44.993517 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:45.016239 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:45.023991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-325e489b-6710-4d35-9444-d7be9a0d7bbf tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.150872 Sep 24 14:32:45.024735 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 331/664] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:44 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:45.044335 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:45.052553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-43b010a4-ce74-46c0-882f-7455604c1845 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.117141 Sep 24 14:32:45.053114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 334/665] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:44 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:45.247974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:45.248598 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:45.254622 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:45.255130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:45.255559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:45.256229 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:45.256673 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:45.257089 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:45.384532 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:45.393587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:45.395071 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:45.396215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b4ed88ce-3e49-4fe5-8cb0-2f0aea0d3b6e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.152153 Sep 24 14:32:45.396766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 332/666] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:45 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:46.047988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:46.048679 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:46.055327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:46.055810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:46.056242 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:46.056945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:46.057374 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:46.057835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:46.076049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:46.076661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:46.083826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:46.084315 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:46.084731 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:46.085415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:46.085862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:46.086279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:46.116933 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:46.117403 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:46.117826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:46.118255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lazy-loading 'fault' on Instance uuid 6840ef33-e118-443d-a97c-235fdaeef563 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:46.162446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a15c0b58b74a476da6723e5478415be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119aafe09e994b0fb512e139c894c5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:46.169955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cf75ba55-f3e4-4804-b1a3-bc008b2a6bbc tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 200 len: 1304 microversion: 2.1 time: 0.098391 Sep 24 14:32:46.170524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 333/667] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:46 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:46.192882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:46.200760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c48c5fed-c0b6-4f13-bb57-cddd8ee921f6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.157345 Sep 24 14:32:46.201320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 335/668] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:46 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:46.421510 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:46.422147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:46.428052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:46.428530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:46.428965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:46.429636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:46.430085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:46.430511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:46.555229 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:46.563675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:46.565097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:46.566236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e4c70b7e-7963-4753-b684-25fb53bd0fa9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.148675 Sep 24 14:32:46.566777 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 334/669] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:46 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:47.208493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:47.209354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] [instance: 6840ef33-e118-443d-a97c-235fdaeef563] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:47.230510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:47.230510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:47.230510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:47.230510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:47.272249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:47.272249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:47.272527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:47.272527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:47.272527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:47.272527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:47.282907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] HTTP exception thrown: Instance 6840ef33-e118-443d-a97c-235fdaeef563 could not be found. Sep 24 14:32:47.283160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:47.283160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:47.283160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Request method failure captured: Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 HTTP/1.1 Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxTSSEeCbbHYG6KPsWGudzCsH1j-yrzyrnenCwewkW-bAim8M_Fz3LMQCxYw4KHjW7BqgEHSGF4XL3hBtaHg2wuKZvaIUsyByzwZl91vnxGPFPxhpSgvif4ClTH0BClRhuh4-L91lksuiY1904laXqOgYvZh68VoO6nN6RxmxOnk9QI Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 119aafe09e994b0fb512e139c894c5e7 Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesNegativeTest-981897463 Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:32:47.288267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/119aafe09e994b0fb512e139c894c5e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_119aafe09e994b0fb512e139c894c5e7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/119aafe09e994b0fb512e139c894c5e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/119aafe09e994b0fb512e139c894c5e7"}]}] Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesNegativeTest-981897463 Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 119aafe09e994b0fb512e139c894c5e7 Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesNegativeTest-981897463 Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesNegativeTest-981897463-project Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: a15c0b58b74a476da6723e5478415be3 Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesNegativeTest-981897463-project Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 6840ef33-e118-443d-a97c-235fdaeef563 could not be found. Sep 24 14:32:47.292742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '6840ef33-e118-443d-a97c-235fdaeef563'} Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6840ef33-e118-443d-a97c-235fdaeef563 could not be found. Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:32:47.305244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6840ef33-e118-443d-a97c-235fdaeef563 could not be found. Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6840ef33-e118-443d-a97c-235fdaeef563 could not be found. Sep 24 14:32:47.308650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:32:47.312141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:47.312141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:47.312495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] Returning 404 to user: Instance 6840ef33-e118-443d-a97c-235fdaeef563 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:32:47.312495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-54374722-7417-419a-9c39-2cd84ded9f31 tempest-VolumesNegativeTest-981897463 tempest-VolumesNegativeTest-981897463-project] 10.222.0.52 "GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563" status: 404 len: 111 microversion: 2.1 time: 0.047861 Sep 24 14:32:47.312495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 336/670] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:47 2022] GET /compute/v2.1/servers/6840ef33-e118-443d-a97c-235fdaeef563 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:32:47.313001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:47.450691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:47.459220 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4cb3e805-50d9-42e9-b622-0cd7260c9922 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.227037 Sep 24 14:32:47.461397 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 335/671] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:47 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:47.591693 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:47.592305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:47.598907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:47.599344 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:47.599779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:47.600469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:47.600920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:47.601342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:47.740365 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:47.749412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:47.751480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:47.752620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e13d8d05-f91e-435c-86fd-347e12cb59bf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.164773 Sep 24 14:32:47.753163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 337/672] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:47 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:48.284940 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:48.287303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:48.293887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.294367 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.294802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.295512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.295960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.296379 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.326186 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lazy-loading 'flavor' on Instance uuid 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:32:48.457827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a036f3ad-99c5-46dc-9c63-7974827ab05b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/action" status: 200 len: 32 microversion: 2.1 time: 0.176928 Sep 24 14:32:48.458523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 336/673] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:32:48 2022] POST /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:32:48.467842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:48.468443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:48.475734 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.476220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.476657 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.477343 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.479088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.479088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.486192 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:48.487366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:48.494288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.494796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.495248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.495945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.496391 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.496986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.658545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:48.666445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b5545652-a4b4-49fa-9555-2f2f270b5d71 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1357 microversion: 2.1 time: 0.184834 Sep 24 14:32:48.667048 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 337/674] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:48 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:48.713330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:48.722456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3ba4571f-a025-41ef-a590-fa833c7f4d34 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.258367 Sep 24 14:32:48.723256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 338/675] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:48 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:48.778301 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:48.779054 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:48.786580 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.787722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.787884 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.788832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:48.790094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:48.790631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:48.925609 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:48.935466 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:48.937007 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:48.938207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7755f93c-4540-4da0-8a07-14af1a117ae8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.163978 Sep 24 14:32:48.939015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 338/676] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:48 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:49.689649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:49.690163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:49.696918 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.697406 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.697843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:49.698576 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.699027 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.699457 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:49.747387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:49.747387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:49.753719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.754395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.754935 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:49.755695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.756452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.756725 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:49.843150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:49.852220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-90583067-b161-447c-a27f-b9bb75211c14 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1546 microversion: 2.1 time: 0.166632 Sep 24 14:32:49.852788 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 339/677] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:49 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:49.876134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:49.876727 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:49.882480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.883204 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.883641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:49.884336 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.884792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.885212 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:49.929059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:49.937600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0d14584d-ee27-46fa-922a-c9c6d75ed5ab tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.195967 Sep 24 14:32:49.938718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 339/678] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:49 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:49.964302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:49.965210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:49.971300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.971776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.972592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:49.973287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:49.973737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:49.974155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:50.035394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:50.044978 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b1da4f29-8bd0-45d7-8a51-6e99b73bc390 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1546 microversion: 2.1 time: 0.172416 Sep 24 14:32:50.045535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 340/679] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:49 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:50.066479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:50.071394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:50.072160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Searching by: {'deleted': False, 'project_id': '8830800be89540929716703bdbb07b13'} {{(pid=120744) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 14:32:50.078929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:50.079413 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:50.079848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:50.080572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:50.081024 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:50.081448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:50.120486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:50.129059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:50.130478 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:50.131653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3db83f5f-905d-42cd-badc-040cde184c7b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.171282 Sep 24 14:32:50.132212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 340/680] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:49 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:32:50.170402 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.multi_cell_list [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120744) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 14:32:50.265975 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cd8a5d81-3144-4084-9143-73a41d007ff2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203577 Sep 24 14:32:50.266493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 341/681] 10.222.0.52 () {58 vars in 1125 bytes} [Sat Sep 24 14:32:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:32:50.277941 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:50.278544 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:50.285592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:50.286070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:50.286526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:50.287253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:50.287753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:50.288353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:50.416000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:50.423693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-35320956-609a-411b-bb1e-832771f2d192 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1546 microversion: 2.1 time: 0.149440 Sep 24 14:32:50.424186 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 341/682] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:50 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:50.961596 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:50.962144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:50.968649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:50.969132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:50.969568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:50.970254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:50.970706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:50.971155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:51.097290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:51.105426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8f6c0b9a-417a-4399-9520-c05861dca8ef tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.147848 Sep 24 14:32:51.106213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 342/683] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:50 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:51.157231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:51.157971 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:51.164139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:51.164842 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:51.165351 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:51.166144 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:51.166672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:51.167191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:51.299986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:51.308485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:51.309926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:51.311098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-93ca72c0-5a95-434d-bb2d-a32ee5480755 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.158086 Sep 24 14:32:51.311811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 342/684] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:51 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:51.973844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7c25200-b053-4961-a350-6086ce07ba5d"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:51.976258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:51.982510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:51.983023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:51.983450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:51.984128 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:51.985179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:51.985478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:52.130718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:52.131862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:52.140254 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:52.140758 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:52.141189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:52.141866 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:52.142320 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:52.142745 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:52.289560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-38eded3c-8dd4-4cc9-8368-27d0bfca136d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319014 Sep 24 14:32:52.291083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 343/685] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:32:51 2022] POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:32:52.297832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:52.306412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a8d05ff7-8de2-4b66-84b0-41b2f652b10f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.180707 Sep 24 14:32:52.307013 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 343/686] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:52 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:32:52.337874 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:52.338483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:52.345193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:52.345666 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:52.346268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:52.346983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:52.347430 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:52.347839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:52.542595 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:52.551584 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:52.553003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:52.554144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-618fab62-e762-4f8e-bf61-8b0bd235e8f6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.220563 Sep 24 14:32:52.554712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 344/687] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:52 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:53.332378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:53.333263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:53.340261 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:53.340917 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:53.341450 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:53.342244 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:53.342790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:53.343448 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:53.580458 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:53.581053 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:53.587986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:53.588465 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:53.588892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:53.589572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:53.590199 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:53.590619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:53.738606 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:53.757712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:53.759452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:53.761217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-20272e05-72a0-409e-a085-4168c273fd58 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.185118 Sep 24 14:32:53.762080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 345/688] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:53 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:32:53.781963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:53.792235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8857247e-af57-4b4f-96ed-871cde764cc2 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.464335 Sep 24 14:32:53.792809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 344/689] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:53 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:54.787880 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:54.789226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:54.795954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:54.796719 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:54.797862 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:54.798799 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:54.799487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:54.800097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:54.816103 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:54.817385 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:54.823602 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:54.830536 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:54.831025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:54.831763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:54.832230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:54.832670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:54.844948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:55.018211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:55.027525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-55df6fed-3575-4164-a445-e9dc228245b9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.215747 Sep 24 14:32:55.028425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 345/690] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:54 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:55.099130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:55.108357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:55.110645 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:55.112124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ec888f02-e7d2-4fc4-8472-1bbe42e9351c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.328296 Sep 24 14:32:55.113252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 346/691] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:54 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:56.052513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:56.053105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:56.070407 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:56.071747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:56.072181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:56.073885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:56.077924 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:56.078646 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:56.142832 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:56.145404 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:56.155413 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=86 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:56.158527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:56.159285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:56.159962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:56.160932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:56.161790 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:56.162535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:56.268029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:56.278886 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-775721f8-fa16-4e62-b984-74030b7babca tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.230116 Sep 24 14:32:56.280471 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 346/692] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:56 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:56.399270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:56.412459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:56.414123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:56.415393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-97876e7c-7024-40c6-bcee-e9803ac9a8d9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.278661 Sep 24 14:32:56.422924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 347/693] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:56 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:57.303985 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:57.304597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:57.311210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:57.311700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:57.313507 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:57.314335 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:57.314887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:57.315326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:57.449945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:57.450790 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:57.459718 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:57.461034 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:57.462529 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:57.464141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:57.465019 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:57.465911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:57.554953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:57.567489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-17ffaf5a-c66c-4fbd-bdba-b96f0fe151be tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.266997 Sep 24 14:32:57.586312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 347/694] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:57 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:57.614189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:57.626447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:57.628197 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:57.629469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3dbe562b-6105-4b1e-9e19-5bef0acdd90e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.185136 Sep 24 14:32:57.630273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 348/695] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:57 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:58.595223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:58.598030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:58.605777 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:58.606697 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:58.607331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:58.608202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:58.608936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:58.610203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:58.665603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:58.667973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:58.679633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:58.681746 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:58.682690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:58.684247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:58.688904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:58.689559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:58.814999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:58.826633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-61365699-dc19-4081-9dc6-4a9935e6c47d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.236298 Sep 24 14:32:58.830968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 348/696] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:58 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:32:59.191739 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-536e950e-3ef5-4f8a-9019-afc2b76699e0 req-0d0a5c3f-51a5-4d30-8526-4c9c95c33fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153f3eef-0f34-4a4a-8738-274bcb2737ca", "name": "network-vif-plugged", "status": "completed", "tag": "42c66fed-6127-4d44-b2b2-1f1ddaf5a32d"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:32:59.210705 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-536e950e-3ef5-4f8a-9019-afc2b76699e0 req-0d0a5c3f-51a5-4d30-8526-4c9c95c33fc2 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:59.211225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-536e950e-3ef5-4f8a-9019-afc2b76699e0 req-0d0a5c3f-51a5-4d30-8526-4c9c95c33fc2 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:59.211659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-536e950e-3ef5-4f8a-9019-afc2b76699e0 req-0d0a5c3f-51a5-4d30-8526-4c9c95c33fc2 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:59.213459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:59.232215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-536e950e-3ef5-4f8a-9019-afc2b76699e0 req-0d0a5c3f-51a5-4d30-8526-4c9c95c33fc2 service nova] Creating event network-vif-plugged:42c66fed-6127-4d44-b2b2-1f1ddaf5a32d for instance 153f3eef-0f34-4a4a-8738-274bcb2737ca on hv-cinder-85919 Sep 24 14:32:59.234173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:59.239499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:32:59.242192 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ed7882c6-f3b2-49c3-afda-c1c335f55099 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.588665 Sep 24 14:32:59.243461 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 349/697] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:32:58 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:32:59.245606 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-536e950e-3ef5-4f8a-9019-afc2b76699e0 req-0d0a5c3f-51a5-4d30-8526-4c9c95c33fc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058186 Sep 24 14:32:59.246212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 349/698] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:32:59.857251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:32:59.857982 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:32:59.868814 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:59.869629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:59.870354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:32:59.872276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:32:59.873409 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:32:59.874714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:00.099886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:00.114385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:00.135158 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2089502c-c459-4ad4-be7d-ecb17811f1a5 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.286956 Sep 24 14:33:00.138002 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 350/699] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:32:59 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:00.269665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:00.271139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:00.287796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:00.288543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:00.292432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:00.297517 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:00.298232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:00.298875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:00.334512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:00.667116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:00.681563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:00.684068 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:00.685242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-74f609bf-b526-444a-88e8-b33412ae7b93 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.420637 Sep 24 14:33:00.687058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 350/700] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:33:00 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:33:01.162708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:01.163486 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:01.187608 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:01.188448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:01.189119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:01.190103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:01.190958 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:01.191696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:01.356687 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:01.366653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-78c49e82-32ac-4ee2-b9f8-7de483c855e0 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.208065 Sep 24 14:33:01.368218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 351/701] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:01 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:01.711942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:01.713288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:01.720183 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:01.721027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:01.721530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:01.723247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:01.723774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:01.724405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:01.954116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:01.965539 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:01.967260 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:01.969422 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-40f6989b-478d-44bf-b9f5-967b65f92c76 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.260847 Sep 24 14:33:01.969980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 351/702] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:33:01 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:33:02.396679 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:02.398525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:02.409202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:02.410726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:02.411447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:02.412911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:02.413737 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:02.415758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:02.470945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:02.472390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:02.480218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:02.480719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:02.481153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:02.481882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:02.487292 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:02.487768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:02.595957 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:02.604241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c17ad5a8-4f94-4fcc-a415-98a5163937cd tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.215252 Sep 24 14:33:02.605046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 352/703] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:02 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:02.649820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:02.661519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ce9bd1fa-5bbc-47cf-99c3-443bbfe6377d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1592 microversion: 2.1 time: 0.194788 Sep 24 14:33:02.662098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 352/704] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:02 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1592 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:33:02.796040 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2b7acadd-db18-4cdf-97e4-af255f45ff4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Action: 'create', calling method: .version_select at 0x7f222e38bca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1733592383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNOcY1OGqIpBcQGcjUZmLjuwbSDFj2boVWbBVl0ykRn+aGj3HK6YK/Fx7LXpp8brgORFJsndFPUA2SCQVEkGDhqnKhMzMtw5fWdJ+lEKseIQJn4p9Cz104hBXqFdbLwYw=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:02.811317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-2b7acadd-db18-4cdf-97e4-af255f45ff4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Getting quotas for project 71699c60daeb48aaaf5b0611c8f68bc4. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:33:02.816113 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-2b7acadd-db18-4cdf-97e4-af255f45ff4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Getting quotas for user e4c9bfcd6d1a401194a7176f8aa2e6ac and project 71699c60daeb48aaaf5b0611c8f68bc4. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:33:02.841622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2b7acadd-db18-4cdf-97e4-af255f45ff4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235376 Sep 24 14:33:02.842341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 353/705] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:33:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:03.004164 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:03.005573 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:03.021648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:03.022981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:03.028226 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:03.030551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:03.032336 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:03.033124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:03.409873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:03.425225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:03.427234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:03.429504 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2e0ebdb1-9990-47b1-b85a-43d52781b9ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1809 microversion: 2.20 time: 0.430266 Sep 24 14:33:03.430151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 353/706] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:33:02 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1809 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:33:03.632002 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:03.632624 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:03.650674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:03.651213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:03.651758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:03.652349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:03.656469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:03.656976 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:03.907447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:03.922593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c7b00910-0d04-4280-a0d1-76dd39d536e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.297775 Sep 24 14:33:03.923660 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 354/707] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:03 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:04.458472 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:04.459851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:04.473118 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:04.473889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:04.474502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:04.475434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:04.476065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:04.476660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:04.716329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:04.726552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:04.728741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:04.730533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0dd48dd0-d551-4f45-a044-8be4da39a492 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1796 microversion: 2.20 time: 0.275908 Sep 24 14:33:04.731400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 354/708] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:33:04 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1796 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:33:04.945520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:04.946668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:04.954464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:04.955011 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:04.955477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:04.956170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:04.956621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:04.957452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:05.151437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:05.164596 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ed54bc89-ccca-4391-94ce-2e8a054f855b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.221477 Sep 24 14:33:05.165841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 355/709] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:04 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:05.641338 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-a77ebf41-e550-4edc-a89a-267f0cb6adcc req-9f99ea50-4415-4e92-ad0a-041bc92040c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb8da2f-7b74-42db-a52b-fe358b040633", "tag": "b51d80e5-325c-440f-824b-228eda3d320a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:05.652456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a77ebf41-e550-4edc-a89a-267f0cb6adcc req-9f99ea50-4415-4e92-ad0a-041bc92040c6 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:05.653275 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a77ebf41-e550-4edc-a89a-267f0cb6adcc req-9f99ea50-4415-4e92-ad0a-041bc92040c6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:05.655127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a77ebf41-e550-4edc-a89a-267f0cb6adcc req-9f99ea50-4415-4e92-ad0a-041bc92040c6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:05.675773 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-a77ebf41-e550-4edc-a89a-267f0cb6adcc req-9f99ea50-4415-4e92-ad0a-041bc92040c6 service nova] Creating event network-changed:b51d80e5-325c-440f-824b-228eda3d320a for instance fdb8da2f-7b74-42db-a52b-fe358b040633 on hv-cinder-85919 Sep 24 14:33:05.680636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-a77ebf41-e550-4edc-a89a-267f0cb6adcc req-9f99ea50-4415-4e92-ad0a-041bc92040c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124739 Sep 24 14:33:05.681427 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 355/710] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:06.189627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:06.190799 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:06.215523 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:06.216029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:06.219705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:06.221872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:06.222420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:06.225820 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:06.486584 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:06.496021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0660f07d-aee5-4295-b074-4634c557d1c9 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.311195 Sep 24 14:33:06.496816 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 356/711] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:06 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:06.861509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1451737593"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:06.862732 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:06.872119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:06.873445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:06.875408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:06.877267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:06.877962 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:06.878493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:07.047576 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.network.security_group_api [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Adding security group aea4aecb-ea94-4294-bdda-2433c5abadc6 to port b51d80e5-325c-440f-824b-228eda3d320a Sep 24 14:33:07.471733 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7882e847-26e1-41ec-9378-5896628b6ee7 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/action" status: 202 len: 0 microversion: 2.1 time: 0.617751 Sep 24 14:33:07.472336 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 356/712] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:33:06 2022] POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:33:07.480966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:07.482129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:07.489173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:07.489851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:07.490436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:07.491349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:07.491971 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:07.492400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:07.526353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:07.532047 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:07.541423 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:07.542441 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:07.543311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:07.544237 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:07.544890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:07.545571 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:07.660611 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:07.670955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7d32d33f-9d30-4a3c-ad1b-cb8b4ee4d8db tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1639 microversion: 2.1 time: 0.194183 Sep 24 14:33:07.672148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 357/713] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:07 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1639 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:07.712886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-436bad81-c765-44ff-bc49-29b3dd3d57c3 req-5201069a-8b18-411e-98bb-767f00ae43e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb8da2f-7b74-42db-a52b-fe358b040633", "tag": "b51d80e5-325c-440f-824b-228eda3d320a"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:07.723616 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-436bad81-c765-44ff-bc49-29b3dd3d57c3 req-5201069a-8b18-411e-98bb-767f00ae43e0 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:07.724102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-436bad81-c765-44ff-bc49-29b3dd3d57c3 req-5201069a-8b18-411e-98bb-767f00ae43e0 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:07.724534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-436bad81-c765-44ff-bc49-29b3dd3d57c3 req-5201069a-8b18-411e-98bb-767f00ae43e0 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:07.727157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:07.735844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-436bad81-c765-44ff-bc49-29b3dd3d57c3 req-5201069a-8b18-411e-98bb-767f00ae43e0 service nova] Creating event network-changed:b51d80e5-325c-440f-824b-228eda3d320a for instance fdb8da2f-7b74-42db-a52b-fe358b040633 on hv-cinder-85919 Sep 24 14:33:07.741729 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b4b1217d-ec6e-4f6e-8bc5-a01a6e268e0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.225153 Sep 24 14:33:07.741976 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-436bad81-c765-44ff-bc49-29b3dd3d57c3 req-5201069a-8b18-411e-98bb-767f00ae43e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036176 Sep 24 14:33:07.743409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 357/714] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:07 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:07.751807 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 358/715] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:08.770267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:08.771510 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:08.778976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:08.779756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:08.780189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:08.781699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:08.782158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:08.782585 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:08.941485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:08.950412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4e661f4e-d07b-4c9f-bb17-3529422b167c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.186418 Sep 24 14:33:08.951021 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 358/716] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:08 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:09.975431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:09.976123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:09.982658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:09.983333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:09.984407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:09.985231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:09.985785 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:09.986305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:10.117324 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:10.126695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-63682c02-e0f5-4694-9f35-9c5ae07394e7 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1735 microversion: 2.1 time: 0.155921 Sep 24 14:33:10.127305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 359/717] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:09 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:11.149739 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:11.150359 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:11.157280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.157766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.158201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.158922 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.159382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.159796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.291322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:11.299919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-78e1dc27-01c2-4774-a5d7-e408e2b7d050 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1715 microversion: 2.1 time: 0.154050 Sep 24 14:33:11.300481 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 359/718] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:11 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:11.414702 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:11.415281 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:11.421690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.422169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.422595 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.423322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.423771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.424185 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.506230 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] HTTP exception thrown: Cannot 'detach_volume' instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 while it is in vm_state rescued Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Request method failure captured: Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments/eb7239a0-dfcf-4c7c-9bbf-1ffb1c4ee3db HTTP/1.1 Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOLWriOc_fWjMg7Oul8BIvVGCEPFVpXgNIV-7u-wMLixvbrHb_bUysnihGjDt4CFF3vG1rqnqpmblstNQee2vVipwt8X8vMiHZG-diq5X4BiTl8z6Fdl-03MaNfIp0c17eGbTPzRVyT4q6mLcE4jSkRUMGjQzKf5Yisq2smRy8uLOo Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:33:11.507884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b458789f89a441caad76e78167bc00b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b458789f89a441caad76e78167bc00b"}]}] Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: c3cf8e31062d4bd7bfa76c09e7e2adea Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:33:11.509437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Cannot 'detach_volume' instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 while it is in vm_state rescued Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'server_id': '6c64d080-3e58-4d1a-a7cc-a2406fc39ce9', 'id': 'eb7239a0-dfcf-4c7c-9bbf-1ffb1c4ee3db'} Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:33:11.510424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 while it is in vm_state rescued Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 while it is in vm_state rescued Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:33:11.511997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Returning 409 to user: Cannot 'detach_volume' instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 while it is in vm_state rescued {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:33:11.513253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-51128244-4133-4216-94fb-b060d9046d2a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments/eb7239a0-dfcf-4c7c-9bbf-1ffb1c4ee3db" status: 409 len: 152 microversion: 2.1 time: 0.099604 Sep 24 14:33:11.513253 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 360/719] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:33:11 2022] DELETE /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments/eb7239a0-dfcf-4c7c-9bbf-1ffb1c4ee3db => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 14:33:11.518748 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:11.519324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:11.525210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.525692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.526134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.526837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.527302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.527731 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.595819 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-556a0feb-7601-4e9d-bf7a-b1245a8fbb83 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "POST /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/action" status: 202 len: 0 microversion: 2.1 time: 0.081216 Sep 24 14:33:11.599860 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 360/720] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:33:11 2022] POST /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:33:11.605804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:11.606403 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:11.612578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.613146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.613594 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.614285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:11.614730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:11.615170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:11.829879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:11.839103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-42f06577-becd-4e69-897f-7995275ec5fb tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1723 microversion: 2.1 time: 0.236977 Sep 24 14:33:11.839672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 361/721] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:11 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:12.863438 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:12.864124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:12.870172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:12.870650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:12.871139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:12.871832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:12.872283 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:12.872697 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:13.013052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:13.022623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bf6985bd-e9aa-40d9-9501-8f83f50c950d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1723 microversion: 2.1 time: 0.163893 Sep 24 14:33:13.023225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 361/722] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:12 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:14.046774 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:14.047444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:14.049876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=4 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:14.055436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:14.055927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:14.056362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:14.057063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:14.057512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:14.057939 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:14.188269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:14.196765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8d1b2f8d-03d5-4d72-b4b3-7e034e71eaec tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1723 microversion: 2.1 time: 0.153823 Sep 24 14:33:14.197342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 362/723] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:14 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:15.223400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:15.223998 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:15.231390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:15.231906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:15.233320 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:15.234059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:15.234535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:15.234992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:15.367419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:15.377008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a7293816-f796-40ea-a0aa-79031b7e426b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1723 microversion: 2.1 time: 0.159829 Sep 24 14:33:15.377569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 362/724] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:15 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:16.401227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:16.401857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:16.408573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:16.409051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:16.409480 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:16.410183 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:16.410631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:16.411094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:16.539170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:16.547725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9daeb88e-9f59-492d-820b-27643b1a2e2f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1729 microversion: 2.1 time: 0.149939 Sep 24 14:33:16.548287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 363/725] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:16 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:16.570648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:16.571206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:16.577538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:16.578022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:16.578458 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:16.579175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:16.579661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:16.580115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:16.659105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8539846a-e589-4463-afc3-4fb26b4215b3 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092253 Sep 24 14:33:16.659697 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 363/726] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:33:16 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:18.016593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-556136d9-22ee-4118-b517-4d91fbba0f6b req-c2d27acb-540f-4a80-909f-a7792d5a6902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c64d080-3e58-4d1a-a7cc-a2406fc39ce9", "tag": "1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:18.028250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-556136d9-22ee-4118-b517-4d91fbba0f6b req-c2d27acb-540f-4a80-909f-a7792d5a6902 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:18.028724 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-556136d9-22ee-4118-b517-4d91fbba0f6b req-c2d27acb-540f-4a80-909f-a7792d5a6902 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:18.029154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-556136d9-22ee-4118-b517-4d91fbba0f6b req-c2d27acb-540f-4a80-909f-a7792d5a6902 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:18.040855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-556136d9-22ee-4118-b517-4d91fbba0f6b req-c2d27acb-540f-4a80-909f-a7792d5a6902 service nova] Creating event network-changed:1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b for instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 on hv-cinder-85919 Sep 24 14:33:18.046268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-556136d9-22ee-4118-b517-4d91fbba0f6b req-c2d27acb-540f-4a80-909f-a7792d5a6902 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033790 Sep 24 14:33:18.047993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 364/727] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:20.069905 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-34807fe7-b665-424d-a715-7dff05326e49 req-448f91bf-afcd-4628-b34e-48e63218b993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c64d080-3e58-4d1a-a7cc-a2406fc39ce9", "tag": "1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:20.074775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=58 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:20.081107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-34807fe7-b665-424d-a715-7dff05326e49 req-448f91bf-afcd-4628-b34e-48e63218b993 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:20.081574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-34807fe7-b665-424d-a715-7dff05326e49 req-448f91bf-afcd-4628-b34e-48e63218b993 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:20.081997 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-34807fe7-b665-424d-a715-7dff05326e49 req-448f91bf-afcd-4628-b34e-48e63218b993 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:20.092827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-34807fe7-b665-424d-a715-7dff05326e49 req-448f91bf-afcd-4628-b34e-48e63218b993 service nova] Creating event network-changed:1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b for instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 on hv-cinder-85919 Sep 24 14:33:20.098268 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-34807fe7-b665-424d-a715-7dff05326e49 req-448f91bf-afcd-4628-b34e-48e63218b993 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032751 Sep 24 14:33:20.098845 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 364/728] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:29.552360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1744470741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1733592383", "security_groups": [{"name": "tempest-secgroup-smoke-309884726"}], "networks": [{"uuid": "c76e3e68-c534-4730-a021-cd40e96a2838"}], "block_device_mapping_v2": [{"uuid": "850ababf-3783-491a-a8f6-449ab531cde6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:29.563446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:29.564107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=99 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:29.668559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] validate_networks() for [('c76e3e68-c534-4730-a021-cd40e96a2838', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:33:30.081571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:33:30.081988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:33:30.082451 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:33:30.082883 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:33:30.083372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:33:30.093029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:30.093501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:30.093928 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:30.094983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:30.095514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:30.095932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:30.112450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Getting quotas for project 71699c60daeb48aaaf5b0611c8f68bc4. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:33:30.116304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Getting quotas for user e4c9bfcd6d1a401194a7176f8aa2e6ac and project 71699c60daeb48aaaf5b0611c8f68bc4. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:33:30.171250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:33:30.173928 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='850ababf-3783-491a-a8f6-449ab531cde6',volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:33:30.302070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-830a9a4c-b1ed-4967-b276-d3d5547973ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753855 Sep 24 14:33:30.302705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 365/729] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:33:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:33:30.311684 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:30.313546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:30.319866 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-40802dfc-066a-4327-883b-a3d5310337ab tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:30.320574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-40802dfc-066a-4327-883b-a3d5310337ab tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:30.377560 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-40802dfc-066a-4327-883b-a3d5310337ab tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:30.385251 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-40802dfc-066a-4327-883b-a3d5310337ab tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1089 microversion: 2.1 time: 0.074749 Sep 24 14:33:30.385841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 365/730] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:30 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:31.407205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:31.407818 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:31.414023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:31.414502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:31.414977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:31.415658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:31.416107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:31.416526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:31.477983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:31.485579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-969bfbf0-563b-4b2a-8d75-a06b1e79363e tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1187 microversion: 2.1 time: 0.083033 Sep 24 14:33:31.486138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 366/731] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:31 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:32.511560 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:32.512352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:32.520798 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:32.521395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:32.521952 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:32.522719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:32.523273 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:32.523768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:32.659713 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:32.667875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fee17bef-4165-4ad8-bea3-e23516d02e68 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.161329 Sep 24 14:33:32.668447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 366/732] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:32 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:33.192366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-5b3d44fb-158a-4492-aec9-431df4940bcd req-8e4e15d8-8fc9-40a0-b2a1-f4de034e0ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5ccce1-e66b-43e2-8c6e-60858051435f", "tag": "22fef065-180c-4fb8-a36d-5b7d245d2726"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:33.203446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-5b3d44fb-158a-4492-aec9-431df4940bcd req-8e4e15d8-8fc9-40a0-b2a1-f4de034e0ebf service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:33.204371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-5b3d44fb-158a-4492-aec9-431df4940bcd req-8e4e15d8-8fc9-40a0-b2a1-f4de034e0ebf service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:33.204859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-5b3d44fb-158a-4492-aec9-431df4940bcd req-8e4e15d8-8fc9-40a0-b2a1-f4de034e0ebf service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:33.219423 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-5b3d44fb-158a-4492-aec9-431df4940bcd req-8e4e15d8-8fc9-40a0-b2a1-f4de034e0ebf service nova] Creating event network-changed:22fef065-180c-4fb8-a36d-5b7d245d2726 for instance 7f5ccce1-e66b-43e2-8c6e-60858051435f on hv-cinder-85919 Sep 24 14:33:33.224163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-5b3d44fb-158a-4492-aec9-431df4940bcd req-8e4e15d8-8fc9-40a0-b2a1-f4de034e0ebf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035586 Sep 24 14:33:33.224747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 367/733] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:33.691030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:33.691626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:33.697454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:33.697934 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:33.698363 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:33.699065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:33.699509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:33.699923 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:33.829053 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:33.836681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-741618fc-b0cd-498d-bd91-347c6763ac06 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.149811 Sep 24 14:33:33.837238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 367/734] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:33 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:34.861387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:34.862084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:34.868180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:34.868659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:34.869089 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:34.869767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:34.870218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:34.870676 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:35.083943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:35.091708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-417dcf7a-0816-4f51-8730-acf0857d0810 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.235641 Sep 24 14:33:35.092445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 368/735] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:34 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:36.114719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:36.115405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:36.121689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:36.122166 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:36.122599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:36.123303 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:36.123755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:36.124175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:36.251764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:36.262683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e9a90587-cb04-4647-ad9a-1aa7826b710c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.151725 Sep 24 14:33:36.263278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 368/736] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:36 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:37.286076 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:37.286835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:37.293214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:37.293694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:37.294119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:37.294787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:37.295258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:37.295670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:37.426114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:37.433616 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-69466d99-9d11-4669-8f56-0a59d4e059f1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.151610 Sep 24 14:33:37.434174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 369/737] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:37 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:38.456466 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:38.457154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:38.463506 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:38.463982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:38.464411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:38.465086 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:38.465533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:38.465951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:38.599528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:38.607015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1242f2e4-65ed-44df-bb1f-65c37e59f3c8 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.154473 Sep 24 14:33:38.607560 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 369/738] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:38 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:39.630105 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:39.630715 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:39.637387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:39.637884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:39.638316 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:39.639032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:39.639518 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:39.640555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:39.767392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:39.774970 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4274e7ce-ca80-4a9b-a787-ae66b5a8c7cf tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.148750 Sep 24 14:33:39.775528 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 370/739] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:39 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:40.797944 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:40.798576 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:40.800923 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:40.806105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:40.806584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:40.807050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:40.807732 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:40.808181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:40.808608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:40.935846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:40.943467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d3425bc0-a75c-460c-b776-82b1d432fc60 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.149928 Sep 24 14:33:40.944035 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 370/740] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:40 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:41.965724 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:41.966334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:41.968288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:41.968959 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:41.975687 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:41.976169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:41.976601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:41.977283 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:41.977730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:41.978148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:42.106837 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:42.114896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3c6cb3dc-af96-482b-8e8d-ff6afaa1e47b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.152991 Sep 24 14:33:42.115454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 371/741] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:41 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:43.137636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:43.138553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:43.146642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:43.147149 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:43.147583 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:43.148271 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:43.148720 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:43.149133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:43.276805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:43.285430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2acdd89e-6fef-478f-b11e-5f443306c41b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.151917 Sep 24 14:33:43.285984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 371/742] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:43 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:44.308761 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:44.309351 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:44.316306 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:44.316786 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:44.317222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:44.317901 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:44.318352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:44.318777 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:44.446188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:44.453857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-afd91364-200f-4c8c-9bc9-bdfd0b30ad91 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.148958 Sep 24 14:33:44.454410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 372/743] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:44 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:45.272253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-770e3757-9722-45b5-b8c8-82ccdcdb0742 req-f86a04c4-3a85-473f-82b9-b508af6f5b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5ccce1-e66b-43e2-8c6e-60858051435f", "name": "network-vif-plugged", "status": "completed", "tag": "22fef065-180c-4fb8-a36d-5b7d245d2726"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:45.285653 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-770e3757-9722-45b5-b8c8-82ccdcdb0742 req-f86a04c4-3a85-473f-82b9-b508af6f5b25 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:45.286152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-770e3757-9722-45b5-b8c8-82ccdcdb0742 req-f86a04c4-3a85-473f-82b9-b508af6f5b25 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:45.286584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-770e3757-9722-45b5-b8c8-82ccdcdb0742 req-f86a04c4-3a85-473f-82b9-b508af6f5b25 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:45.298030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-770e3757-9722-45b5-b8c8-82ccdcdb0742 req-f86a04c4-3a85-473f-82b9-b508af6f5b25 service nova] Creating event network-vif-plugged:22fef065-180c-4fb8-a36d-5b7d245d2726 for instance 7f5ccce1-e66b-43e2-8c6e-60858051435f on hv-cinder-85919 Sep 24 14:33:45.304398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-770e3757-9722-45b5-b8c8-82ccdcdb0742 req-f86a04c4-3a85-473f-82b9-b508af6f5b25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035240 Sep 24 14:33:45.305158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 372/744] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:33:45.477000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:45.478232 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:45.487978 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:45.488414 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:45.488841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:45.489732 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:45.490180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:45.490615 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:45.684705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:45.692475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c7501382-12e5-49b0-b13a-ef5e161e31dd tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.219995 Sep 24 14:33:45.693055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 373/745] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:45 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:46.714656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:46.715367 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:46.722549 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:46.723051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:46.723482 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:46.724152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:46.724596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:46.725011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:46.855524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:46.863603 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4543567b-70dd-4f86-b504-b4b5423a1635 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1260 microversion: 2.1 time: 0.153108 Sep 24 14:33:46.864153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 373/746] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:46 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:47.886989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:47.887593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:47.894488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:47.895027 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:47.895502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:47.896361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:47.896949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:47.897374 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:48.026358 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:48.034281 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-713a6f1b-0d6d-4517-882d-78bd42a2e281 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1444 microversion: 2.1 time: 0.151277 Sep 24 14:33:48.034854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 374/747] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:47 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:48.056486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:33:48.057101 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:33:48.063811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:48.064293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:48.064755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:48.065438 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:48.065893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:48.066314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:48.191887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:33:48.199585 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8c877388-8644-420b-87be-fc3bb667dd57 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1444 microversion: 2.1 time: 0.146921 Sep 24 14:33:48.200143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 374/748] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:33:48 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:33:49.763819 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-327b2abb-2330-496c-9d02-1b23c9a6e893 req-39c934d8-362b-4459-a2a8-2dadf6058ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5ccce1-e66b-43e2-8c6e-60858051435f", "tag": "22fef065-180c-4fb8-a36d-5b7d245d2726"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:33:49.773377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-327b2abb-2330-496c-9d02-1b23c9a6e893 req-39c934d8-362b-4459-a2a8-2dadf6058ab6 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:33:49.773850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-327b2abb-2330-496c-9d02-1b23c9a6e893 req-39c934d8-362b-4459-a2a8-2dadf6058ab6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:33:49.774267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-327b2abb-2330-496c-9d02-1b23c9a6e893 req-39c934d8-362b-4459-a2a8-2dadf6058ab6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:33:49.785512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-327b2abb-2330-496c-9d02-1b23c9a6e893 req-39c934d8-362b-4459-a2a8-2dadf6058ab6 service nova] Creating event network-changed:22fef065-180c-4fb8-a36d-5b7d245d2726 for instance 7f5ccce1-e66b-43e2-8c6e-60858051435f on hv-cinder-85919 Sep 24 14:33:49.790500 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-327b2abb-2330-496c-9d02-1b23c9a6e893 req-39c934d8-362b-4459-a2a8-2dadf6058ab6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030313 Sep 24 14:33:49.791317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 375/749] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:22.378837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:22.379402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:22.381521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=22 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:22.382159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=50 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:22.386801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:22.387371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:22.387796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:22.388475 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:22.388942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:22.389352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:22.421631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c0a926aa-412b-4566-a2ba-95ea4990f5c7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments/f5811766-065a-4b09-bd00-a4d473184487" status: 200 len: 194 microversion: 2.20 time: 0.046962 Sep 24 14:34:22.422195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 375/750] 10.222.0.52 () {60 vars in 1454 bytes} [Sat Sep 24 14:34:22 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments/f5811766-065a-4b09-bd00-a4d473184487 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:34:22.489629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:22.490445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=54 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:22.494763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:22.495364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:22.502491 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:22.503004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:22.503440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:22.504126 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:22.504577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:22.505026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:22.586435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lazy-loading 'services' on Instance uuid 153f3eef-0f34-4a4a-8738-274bcb2737ca {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:34:22.662768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8b68c806-f396-4f53-a085-e8efeade007e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments/f5811766-065a-4b09-bd00-a4d473184487" status: 202 len: 0 microversion: 2.20 time: 0.174310 Sep 24 14:34:22.666033 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 376/751] 10.222.0.52 () {60 vars in 1457 bytes} [Sat Sep 24 14:34:22 2022] DELETE /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments/f5811766-065a-4b09-bd00-a4d473184487 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:34:22.680755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:22.685446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:22.691951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:22.692422 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:22.692889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:22.693586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:22.694041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:22.694466 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:22.725733 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1575173d-042a-4b8b-9bef-054dc91b8be7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054843 Sep 24 14:34:22.726288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 376/752] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 14:34:22 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:34:23.739356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:23.741353 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:23.747766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:23.748243 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:23.749188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:23.749943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:23.750396 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:23.750831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:23.782607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5e606b7a-b44f-4261-97c6-9640225ee044 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048009 Sep 24 14:34:23.783187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 377/753] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 14:34:23 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:34:24.794463 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:24.797163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:24.803652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:24.804155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:24.804582 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:24.805261 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:24.805708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:24.806159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:24.835389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dc1fa215-16ab-4099-8da9-b037f88c5973 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044620 Sep 24 14:34:24.835727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 377/754] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 14:34:24 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:24.900774 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:24.901308 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:24.907971 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:24.908445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:24.908872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:24.909546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:24.909989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:24.910407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:24.935621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Going to try to terminate instance {{(pid=120744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:34:25.020647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e805d7ff-b787-450b-bed9-9685fd71fb82 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 204 len: 0 microversion: 2.20 time: 0.123441 Sep 24 14:34:25.021448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 378/755] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 14:34:24 2022] DELETE /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 14:34:25.029925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:25.030537 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:25.038597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:25.039142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:25.039670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:25.040378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:25.040928 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:25.041375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:25.171969 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:25.180029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:25.181462 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:25.182610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6d411a1f-b237-43e5-be4d-7dc432b19bdd tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.156924 Sep 24 14:34:25.183204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 378/756] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:25 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:26.209071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:26.209768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:26.216571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:26.217055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:26.217505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:26.218167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:26.218619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:26.219065 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:26.345138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:26.353441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:26.354925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:26.356076 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9fe97e57-6bc7-4e5d-a6dc-c86e8ba49f34 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.151320 Sep 24 14:34:26.356631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 379/757] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:26 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:27.381699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:27.382447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:27.388882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:27.389437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:27.389945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:27.390637 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:27.391111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:27.391533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:27.523379 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:27.531741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:27.533179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:27.534325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-07f32579-eeb8-4928-8717-7149716f0956 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1724 microversion: 2.20 time: 0.156630 Sep 24 14:34:27.534903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 379/758] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:27 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:28.051214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-4fe7f08f-4432-421c-9c7d-05850019ce3a req-1884e30d-9859-4d93-909e-6af33b5007f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153f3eef-0f34-4a4a-8738-274bcb2737ca", "name": "network-vif-deleted", "tag": "42c66fed-6127-4d44-b2b2-1f1ddaf5a32d"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:28.064473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-4fe7f08f-4432-421c-9c7d-05850019ce3a req-1884e30d-9859-4d93-909e-6af33b5007f2 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:28.064943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-4fe7f08f-4432-421c-9c7d-05850019ce3a req-1884e30d-9859-4d93-909e-6af33b5007f2 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:28.065365 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-4fe7f08f-4432-421c-9c7d-05850019ce3a req-1884e30d-9859-4d93-909e-6af33b5007f2 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:28.078366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-4fe7f08f-4432-421c-9c7d-05850019ce3a req-1884e30d-9859-4d93-909e-6af33b5007f2 service nova] Creating event network-vif-deleted:42c66fed-6127-4d44-b2b2-1f1ddaf5a32d for instance 153f3eef-0f34-4a4a-8738-274bcb2737ca on hv-cinder-85919 Sep 24 14:34:28.085609 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-4fe7f08f-4432-421c-9c7d-05850019ce3a req-1884e30d-9859-4d93-909e-6af33b5007f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037635 Sep 24 14:34:28.086212 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 380/759] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:28.559446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:28.560055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:28.566940 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:28.567425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:28.567860 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:28.568547 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:28.568996 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:28.569425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:28.602530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:28.603370 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:28.604001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:28.604654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lazy-loading 'fault' on Instance uuid 153f3eef-0f34-4a4a-8738-274bcb2737ca {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:34:28.663183 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:28.675314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:28.677591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:28.681189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7b2f9da7-8afd-4d45-8a5f-babf451463aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 200 len: 1372 microversion: 2.20 time: 0.124772 Sep 24 14:34:28.681779 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 380/760] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:28 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 1372 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:29.709012 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:29.709700 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:29.716366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:29.716846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:29.717271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:29.717952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:29.718413 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:29.718833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:29.734198 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] HTTP exception thrown: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Request method failure captured: Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca HTTP/1.1 Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOOH9gj2RdEW891oSPJTXS3S25NXC1pJYJ9yGYn-9tAQJt7A0MvPzna3lGV-qZQzyxgrRTPm4t69sM9Pupgx94V7WXIQpfnU4Quzo2hkK_82LDEGYCmTFZIPzNSWErsY8EQKmm7Vd_P8DltwIILs3MqHQm6XDbW5l_2bhFvfSn_I2U Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:34:29.735851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1f7134ad65014cb984417c99b3d76eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1f7134ad65014cb984417c99b3d76eff"}]}] Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 883e6570afb84a099e46cdace5a88b2e Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:34:29.737560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '153f3eef-0f34-4a4a-8738-274bcb2737ca'} Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:34:29.738775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:34:29.740096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:29.741847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Returning 404 to user: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:34:29.741847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-276173a6-b545-45b1-8389-3fbb4eba7f31 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 404 len: 111 microversion: 2.20 time: 0.032750 Sep 24 14:34:29.741847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 381/761] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:29 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:34:29.746791 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-afc400de-267b-49fc-bea2-07dfe0ca0867 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '.version_select at 0x7f222aa009d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:29.780655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-afc400de-267b-49fc-bea2-07dfe0ca0867 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063684187" status: 204 len: 0 microversion: 2.20 time: 0.037713 Sep 24 14:34:29.781221 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 381/762] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 14:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063684187 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 14:34:30.705806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bdcf76c4-1fee-4e5c-a2e9-59b6301de686 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'create', calling method: .version_select at 0x7f222e2374c0>, body: {"keypair": {"name": "tempest-keypair-2007924367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM39Lsxqt5mN0ouLsYbbSqxf4PakFFjFgvRXmIUODD8qPAC9wDEx6iOj7Dgk4mfTWSTrcef4bbmLduBZh1Y08GpYIn9OL6lin6NsmvFajHgppzlu0IAxRv2abLplehVcgQ=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:30.724255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-bdcf76c4-1fee-4e5c-a2e9-59b6301de686 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for project 1f7134ad65014cb984417c99b3d76eff. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:34:30.728292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-bdcf76c4-1fee-4e5c-a2e9-59b6301de686 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for user 883e6570afb84a099e46cdace5a88b2e and project 1f7134ad65014cb984417c99b3d76eff. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:34:30.751897 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-bdcf76c4-1fee-4e5c-a2e9-59b6301de686 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051363 Sep 24 14:34:30.752490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 382/763] 10.222.0.52 () {62 vars in 1200 bytes} [Sat Sep 24 14:34:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 24 14:34:32.218519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1270049519", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "841ec28f-242a-4287-8d65-ef9f3927d5d5"}], "security_groups": [{"name": "tempest-securitygroup--66271039"}], "key_name": "tempest-keypair-2007924367", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:32.318887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] validate_networks() for [('841ec28f-242a-4287-8d65-ef9f3927d5d5', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:34:32.689201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:34:32.689621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:34:32.690128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:34:32.690536 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:34:32.690976 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:34:32.699739 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:32.700217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:32.700646 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:32.701364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:32.702422 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:32.702869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:32.719322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for project 1f7134ad65014cb984417c99b3d76eff. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:34:32.723252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Getting quotas for user 883e6570afb84a099e46cdace5a88b2e and project 1f7134ad65014cb984417c99b3d76eff. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:34:32.734119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:34:32.736450 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:34:32.783123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0d0b0f16-bd35-47bb-8d24-58c36a320cfc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.569370 Sep 24 14:34:32.783765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 382/764] 10.222.0.52 () {62 vars in 1188 bytes} [Sat Sep 24 14:34:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 14:34:32.795826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3b79a796-bd35-415b-8fd0-f5d9fa27a8a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:32.796434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3b79a796-bd35-415b-8fd0-f5d9fa27a8a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:32.852560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3b79a796-bd35-415b-8fd0-f5d9fa27a8a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:32.860764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3b79a796-bd35-415b-8fd0-f5d9fa27a8a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:32.862257 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3b79a796-bd35-415b-8fd0-f5d9fa27a8a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:32.863382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3b79a796-bd35-415b-8fd0-f5d9fa27a8a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1282 microversion: 2.20 time: 0.072097 Sep 24 14:34:32.863930 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 383/765] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:32 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:34:33.504267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:33.506665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:33.513943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:33.514434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:33.514901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:33.515622 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:33.516072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:33.516493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:33.590746 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6d956ee9-e639-4bb8-9468-e4d53da73851 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/action" status: 202 len: 0 microversion: 2.1 time: 0.090683 Sep 24 14:34:33.591626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 383/766] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:34:33 2022] POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:34:33.601885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:33.602631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:33.609828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:33.610508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:33.611265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:33.612157 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:33.612682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:33.613271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:33.762747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:33.771325 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7567fe7e-83e0-4299-848c-0e5116457347 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1750 microversion: 2.1 time: 0.173531 Sep 24 14:34:33.771916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 384/767] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:33 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:33.887384 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:33.888099 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:33.894212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:33.894695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:33.895155 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:33.895849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:33.896298 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:33.896721 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:33.958610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:33.967879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:33.969317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:33.970428 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9a4de2f3-32af-4531-bf59-cc6cfa16e717 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1334 microversion: 2.20 time: 0.087312 Sep 24 14:34:33.971013 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 384/768] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:33 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:34.067524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:34.068652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:34.075461 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:34.076023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:34.076454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:34.077141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:34.077591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:34.078056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:34.183041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lazy-loading 'services' on Instance uuid 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:34:34.257998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0e2dc176-b091-4f30-9b1f-abde9b4fdb0d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments/eb7239a0-dfcf-4c7c-9bbf-1ffb1c4ee3db" status: 202 len: 0 microversion: 2.1 time: 0.194445 Sep 24 14:34:34.258621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 385/769] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:34:34 2022] DELETE /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments/eb7239a0-dfcf-4c7c-9bbf-1ffb1c4ee3db => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:34:34.274599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:34.280411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:34.288730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:34.289217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:34.289648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:34.290343 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:34.290787 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:34.291457 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:34.321784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-601dbfe1-2e2f-4aa7-abff-3fdeafbbc476 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058739 Sep 24 14:34:34.322341 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 385/770] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:34:34 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:34.796139 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:34.796754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:34.803259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:34.803747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:34.804181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:34.804874 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:34.805327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:34.805752 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:34.996079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:34.996690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:35.003572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:35.004058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:35.004494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:35.005179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:35.005632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:35.006056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:35.057943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:35.073684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cd00098a-38e9-48f1-b593-91f9594962ed tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1750 microversion: 2.1 time: 0.281603 Sep 24 14:34:35.075727 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 386/771] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:34 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1750 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:35.170126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:35.180340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:35.182977 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:35.184321 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f51ec7c6-9327-4eea-90dc-7d5a610df9de tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.192343 Sep 24 14:34:35.185330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 386/772] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:34 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:34:35.335681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:35.338546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:35.344501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:35.344984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:35.345412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:35.346101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:35.346548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:35.346994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:35.377132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-631a9f45-1f47-4bcf-bfaa-7ece877f20ee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046007 Sep 24 14:34:35.377688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 387/773] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:34:35 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:35.911529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-b7cb1ff7-b670-4b69-9db7-f37693a459fe req-fff1ccd8-fa0d-48a9-8ffe-f29cf0375825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3195e775-0693-43e1-98c5-6da051739679", "tag": "9bcbf202-4cbf-42d4-9889-2c337cd6d929"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:35.922114 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b7cb1ff7-b670-4b69-9db7-f37693a459fe req-fff1ccd8-fa0d-48a9-8ffe-f29cf0375825 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:35.922646 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b7cb1ff7-b670-4b69-9db7-f37693a459fe req-fff1ccd8-fa0d-48a9-8ffe-f29cf0375825 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:35.923165 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b7cb1ff7-b670-4b69-9db7-f37693a459fe req-fff1ccd8-fa0d-48a9-8ffe-f29cf0375825 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:35.934165 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-b7cb1ff7-b670-4b69-9db7-f37693a459fe req-fff1ccd8-fa0d-48a9-8ffe-f29cf0375825 service nova] Creating event network-changed:9bcbf202-4cbf-42d4-9889-2c337cd6d929 for instance 3195e775-0693-43e1-98c5-6da051739679 on hv-cinder-85919 Sep 24 14:34:35.939012 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-b7cb1ff7-b670-4b69-9db7-f37693a459fe req-fff1ccd8-fa0d-48a9-8ffe-f29cf0375825 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031243 Sep 24 14:34:35.939685 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 387/774] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:36.098049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:36.098657 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:36.104959 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.105440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.105874 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.106559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.107041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.107465 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.212990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:36.213690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:36.220691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.221173 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.221606 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.222287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.222734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.223180 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.334902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:36.343782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5617a9b6-6270-4fc3-9105-a928bfd0469d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.249560 Sep 24 14:34:36.344369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 388/775] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:36 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:36.353116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:36.361502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:36.362958 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:36.364058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-db77197c-8330-4f95-8e36-f01ec0f25a28 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.155785 Sep 24 14:34:36.364604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 388/776] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:36 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:34:36.390262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:36.392658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:36.399186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.399894 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.400348 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.401140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.401665 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.402167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.432371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7d5a1a0f-c212-4bd7-931e-abd77cf6ed93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046723 Sep 24 14:34:36.433039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 389/777] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:34:36 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:34:36.517845 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:36.518359 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:36.524314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.524801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.525240 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.525929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.526385 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.526808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.552574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:34:36.625380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-92bd07fd-1bad-4c67-866d-fbd9c69abd93 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 204 len: 0 microversion: 2.1 time: 0.111196 Sep 24 14:34:36.625947 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 389/778] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:34:36 2022] DELETE /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:34:36.633928 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:36.634541 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:36.640962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.641392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.641828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.642515 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:36.643001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:36.643427 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:36.775872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:36.783764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0c2168bb-a87f-4ac1-bb16-060b8722a075 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1689 microversion: 2.1 time: 0.153748 Sep 24 14:34:36.784357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 390/779] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:36 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:37.368005 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:37.368697 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:37.375025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:37.375504 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:37.375936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:37.376607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:37.377055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:37.377474 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:37.389143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:37.389756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:37.396229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:37.396714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:37.397148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:37.397830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:37.398277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:37.398694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:37.521950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:37.525536 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:37.527338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:37.532036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1f1546cf-cf9d-45a4-9687-97583043fea6 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.168277 Sep 24 14:34:37.532613 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 390/780] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:37 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:37.536123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:37.537545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:37.538628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a5d65ebd-c889-4879-8612-b0d31c84ba25 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.153446 Sep 24 14:34:37.539270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 391/781] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:37 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:34:37.808060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:37.808659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:37.815559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:37.816033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:37.816462 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:37.817139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:37.817580 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:37.817991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:37.943995 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:37.952145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-abd53106-943c-4b30-86b1-492cc0e1e88d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1689 microversion: 2.1 time: 0.147871 Sep 24 14:34:37.952700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 391/782] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:37 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:38.555045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:38.555652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:38.562835 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:38.563456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:38.564134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:38.564622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:38.565057 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:38.565745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:38.566195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:38.566613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:38.569723 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:38.570210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:38.570647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:38.571360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:38.571817 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:38.572243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:38.698671 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:38.706884 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:38.708346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:38.709199 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:38.709456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cafb98a6-ef0d-4c5d-8ddf-025a83a77753 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.151133 Sep 24 14:34:38.710019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 392/783] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:38 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:34:38.713023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:38.720008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-14021127-3102-4fb8-b6e4-4b79fa39d9f9 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.168562 Sep 24 14:34:38.720688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 392/784] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:38 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:38.974671 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:38.975236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:38.981149 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:38.981623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:38.982059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:38.982744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:38.983228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:38.983657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:39.111032 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:39.118887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4d8119e2-069e-4e53-b7b9-5e045f51cd53 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1689 microversion: 2.1 time: 0.148066 Sep 24 14:34:39.119472 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 393/785] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:38 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:39.734654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:39.735289 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:39.742638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:39.743188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:39.743627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:39.744314 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:39.744763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:39.745077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:39.745487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:39.745715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:39.752589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:39.753085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:39.753577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:39.754275 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:39.754725 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:39.755176 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:39.883483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:39.892013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:39.893477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:39.894625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9e78e842-a5dc-4676-8cb4-bf962e7e7605 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.163866 Sep 24 14:34:39.895136 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 393/786] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:39 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:39.897190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:39.906409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9acfbf44-8481-4935-ac9a-df5d013c7e0e tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.165331 Sep 24 14:34:39.906983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 394/787] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:39 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:40.143259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:40.143899 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:40.149720 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:40.150311 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:40.150744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:40.151446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:40.151894 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:40.152311 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:40.278833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:40.286314 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-406beb7c-327d-4b08-b9e8-a6be421bc39a tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1689 microversion: 2.1 time: 0.147666 Sep 24 14:34:40.286882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 394/788] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:40 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:40.920305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:40.920952 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:40.927389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:40.927877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:40.928309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:40.928991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:40.929190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:40.929592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:40.929822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:40.929934 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:40.936622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:40.937094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:40.937520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:40.938198 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:40.938642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:40.939091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:41.059892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:41.068596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:41.070064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:41.071184 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-61edbce3-e02a-4930-a544-6d768aa0b5a9 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.154793 Sep 24 14:34:41.071745 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 395/789] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:40 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:41.079327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:41.087591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8fec82cb-ebaf-4e09-b06f-3fd440242115 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.162102 Sep 24 14:34:41.088085 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 395/790] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:40 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:34:41.309472 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:41.310085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:41.316570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:41.317057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:41.317498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:41.318192 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:41.318644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:41.319094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:41.445896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:41.453895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bfaddd33-a562-4e48-bfd2-9733625aa18e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1689 microversion: 2.1 time: 0.148250 Sep 24 14:34:41.454564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 396/791] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:41 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:42.096732 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:42.097254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:42.103468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:42.103948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:42.104413 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:42.105088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:42.105723 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:42.105951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:42.111086 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:42.111811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:42.118052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:42.118525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:42.118992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:42.119674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:42.120113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:42.120526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:42.236583 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:42.244575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:42.246150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:42.247275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b32613fa-9b44-4f4d-8e6e-cb5c1fe5f0a7 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.154601 Sep 24 14:34:42.248465 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 396/792] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:42 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:42.264590 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:42.272808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-37553157-485c-4a22-bde1-f548ddb1bf6b tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.166045 Sep 24 14:34:42.273364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 397/793] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:42 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:34:42.477207 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:42.477923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:42.484288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:42.484759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:42.485185 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:42.485853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:42.486300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:42.486711 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:42.613108 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:42.620574 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0f3edff5-7c8e-4357-852f-56abab75b20d tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1689 microversion: 2.1 time: 0.147190 Sep 24 14:34:42.621129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 397/794] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:42 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:43.272468 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:43.273076 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:43.274911 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:43.275560 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:43.282459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:43.282970 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:43.283404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:43.284087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:43.284535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:43.284950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:43.296475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:43.297101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:43.299007 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:43.305299 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:43.305789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:43.306220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:43.306933 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:43.307385 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:43.307804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:43.429895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:43.438593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:43.440062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:43.441767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0f74b62d-2e0b-46b5-a278-217435b4d66a tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.172583 Sep 24 14:34:43.442324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 398/795] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:43 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:43.447193 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-dcb10b2d-ae02-4017-ad86-b63503b697aa req-23b2ae43-bd54-4136-947b-033f19d46c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195e775-0693-43e1-98c5-6da051739679", "name": "network-vif-plugged", "status": "completed", "tag": "9bcbf202-4cbf-42d4-9889-2c337cd6d929"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:43.457485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-dcb10b2d-ae02-4017-ad86-b63503b697aa req-23b2ae43-bd54-4136-947b-033f19d46c1f service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:43.457678 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-dcb10b2d-ae02-4017-ad86-b63503b697aa req-23b2ae43-bd54-4136-947b-033f19d46c1f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:43.458072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-dcb10b2d-ae02-4017-ad86-b63503b697aa req-23b2ae43-bd54-4136-947b-033f19d46c1f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:43.469569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-dcb10b2d-ae02-4017-ad86-b63503b697aa req-23b2ae43-bd54-4136-947b-033f19d46c1f service nova] Creating event network-vif-plugged:9bcbf202-4cbf-42d4-9889-2c337cd6d929 for instance 3195e775-0693-43e1-98c5-6da051739679 on hv-cinder-85919 Sep 24 14:34:43.474723 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-dcb10b2d-ae02-4017-ad86-b63503b697aa req-23b2ae43-bd54-4136-947b-033f19d46c1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031069 Sep 24 14:34:43.475354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 399/796] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:43.475559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:43.485047 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0873e726-b665-404a-9091-8c2c43c97530 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.192806 Sep 24 14:34:43.487250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 398/797] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:43 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:43.644741 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:43.645437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:43.651491 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:43.651953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:43.652387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:43.653072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:43.653778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:43.655010 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:43.801389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:43.812108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7bdf52a2-5b69-4c40-bbea-bfcec9152d40 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1689 microversion: 2.1 time: 0.171111 Sep 24 14:34:43.812600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 400/798] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:43 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:44.467361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:44.467929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:44.474424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:44.474939 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:44.475369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:44.476059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:44.476504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:44.476917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:44.508511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:44.509307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:44.515461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:44.516034 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:44.516540 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:44.517352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:44.517882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:44.518355 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:44.658228 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:44.668064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-05f6fa93-e237-43be-a602-4e29113dd717 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.163308 Sep 24 14:34:44.668632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 401/799] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:44 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:34:44.723250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:44.734697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:44.736495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:44.737753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-68cf58eb-fce7-498d-a515-d00066e4c878 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.274291 Sep 24 14:34:44.738512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 399/800] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:44 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:34:44.834895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:44.835538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:44.842107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:44.842587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:44.843043 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:44.843730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:44.844176 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:44.844592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:44.905078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:44.912676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8dfc01ad-fdac-4aed-adbf-71ad0859a658 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1622 microversion: 2.1 time: 0.081731 Sep 24 14:34:44.913235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 402/801] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:44 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1622 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:45.026348 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-5f0b4a2a-2b13-49ba-b109-7d8244e2453b req-ef0a4919-9aff-42c7-9a17-55943cd69823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c64d080-3e58-4d1a-a7cc-a2406fc39ce9", "name": "network-vif-deleted", "tag": "1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:45.037331 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-5f0b4a2a-2b13-49ba-b109-7d8244e2453b req-ef0a4919-9aff-42c7-9a17-55943cd69823 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:45.037802 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-5f0b4a2a-2b13-49ba-b109-7d8244e2453b req-ef0a4919-9aff-42c7-9a17-55943cd69823 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:45.038429 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-5f0b4a2a-2b13-49ba-b109-7d8244e2453b req-ef0a4919-9aff-42c7-9a17-55943cd69823 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:45.051572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-5f0b4a2a-2b13-49ba-b109-7d8244e2453b req-ef0a4919-9aff-42c7-9a17-55943cd69823 service nova] Creating event network-vif-deleted:1ba4ea7b-1ad2-4458-a277-d58b39c2ad8b for instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 on hv-cinder-85919 Sep 24 14:34:45.056978 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-5f0b4a2a-2b13-49ba-b109-7d8244e2453b req-ef0a4919-9aff-42c7-9a17-55943cd69823 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034305 Sep 24 14:34:45.057744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 400/802] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:45.692437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:45.693088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:45.700048 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:45.700854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:45.701798 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:45.702494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:45.704245 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:45.704674 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:45.764131 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:45.765077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:45.772753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:45.772753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:45.773283 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:45.774040 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:45.774559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:45.775326 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:45.889411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:45.904327 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f39b40ca-8cc1-4dd0-84bc-5f8a3e3df9c2 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.215589 Sep 24 14:34:45.905634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 403/803] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:45 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:45.937723 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:45.938340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:45.942259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:45.956826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:45.960668 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:45.961200 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:45.961497 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:45.961632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:45.964549 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:45.964682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0f0ab2ca-a825-459b-bb80-bb699e2b4b90 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1406 microversion: 2.20 time: 0.204894 Sep 24 14:34:45.967232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:45.967753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:45.967942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 401/804] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:45 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:34:46.015922 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:46.016681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:46.017118 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:46.017560 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lazy-loading 'fault' on Instance uuid 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:34:46.059593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:46.067969 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3797d291-82cf-420a-977b-eacf4b9b2cee tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 200 len: 1335 microversion: 2.1 time: 0.134815 Sep 24 14:34:46.068535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 404/805] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:45 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:34:46.929568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:46.930172 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:46.937220 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:46.937696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:46.938122 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:46.938799 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:46.939266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:46.939683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:46.992944 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:46.993539 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:47.000091 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:47.000622 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:47.001059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:47.001744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:47.002191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:47.002610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:47.078860 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:47.087386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a4652d27-0b15-410b-b1e0-e16dc38e4005 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.161637 Sep 24 14:34:47.087884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 402/806] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:46 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:47.093313 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:47.093921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:47.099863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:47.100350 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:47.100782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:47.101475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:47.101927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:47.102344 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:47.116016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] HTTP exception thrown: Instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 could not be found. Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Request method failure captured: Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 HTTP/1.1 Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOLWriOc_fWjMg7Oul8BIvVGCEPFVpXgNIV-7u-wMLixvbrHb_bUysnihGjDt4CFF3vG1rqnqpmblstNQee2vVipwt8X8vMiHZG-diq5X4BiTl8z6Fdl-03MaNfIp0c17eGbTPzRVyT4q6mLcE4jSkRUMGjQzKf5Yisq2smRy8uLOo Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:34:47.117659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b458789f89a441caad76e78167bc00b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b458789f89a441caad76e78167bc00b"}]}] Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: c3cf8e31062d4bd7bfa76c09e7e2adea Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 could not be found. Sep 24 14:34:47.119370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '6c64d080-3e58-4d1a-a7cc-a2406fc39ce9'} Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 could not be found. Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:34:47.120219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 could not be found. Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 could not be found. Sep 24 14:34:47.121776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:47.123961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Returning 404 to user: Instance 6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:34:47.123961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-abffb993-c667-4d50-9fed-044cae51fb78 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9" status: 404 len: 111 microversion: 2.1 time: 0.030248 Sep 24 14:34:47.123961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 403/807] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:47 2022] GET /compute/v2.1/servers/6c64d080-3e58-4d1a-a7cc-a2406fc39ce9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:47.127842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8675c3ea-5ce2-4979-94f5-cf9a6b09aa52 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '.version_select at 0x7f222e3590d0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:47.131217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:47.139603 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:47.141153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:47.142450 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-42410943-1e3f-4f88-aa9f-5a53cebd9161 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1597 microversion: 2.20 time: 0.153329 Sep 24 14:34:47.143625 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 405/808] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:34:46 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:34:47.161057 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8675c3ea-5ce2-4979-94f5-cf9a6b09aa52 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-915055095" status: 202 len: 0 microversion: 2.1 time: 0.036819 Sep 24 14:34:47.161865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 404/809] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 14:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-915055095 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:34:47.170632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:47.171153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:47.177608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:47.178150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:47.178606 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:47.179368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:47.180280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:47.180280 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:47.269623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-78320813-0b77-4354-b31b-ee64cd123d01 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103442 Sep 24 14:34:47.270863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 406/810] 10.222.0.52 () {60 vars in 1316 bytes} [Sat Sep 24 14:34:47 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:34:48.112661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:48.113301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:48.120162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:48.120576 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:48.121003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:48.121680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:48.122129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:48.122589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:48.224779 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-f3484863-923e-4031-83a4-e97f36b10702 req-b48fb38c-4fff-4ecd-817a-14407b065c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3195e775-0693-43e1-98c5-6da051739679", "tag": "9bcbf202-4cbf-42d4-9889-2c337cd6d929"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:48.236670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f3484863-923e-4031-83a4-e97f36b10702 req-b48fb38c-4fff-4ecd-817a-14407b065c8b service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:48.237236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f3484863-923e-4031-83a4-e97f36b10702 req-b48fb38c-4fff-4ecd-817a-14407b065c8b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:48.237775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f3484863-923e-4031-83a4-e97f36b10702 req-b48fb38c-4fff-4ecd-817a-14407b065c8b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:48.253502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-f3484863-923e-4031-83a4-e97f36b10702 req-b48fb38c-4fff-4ecd-817a-14407b065c8b service nova] Creating event network-changed:9bcbf202-4cbf-42d4-9889-2c337cd6d929 for instance 3195e775-0693-43e1-98c5-6da051739679 on hv-cinder-85919 Sep 24 14:34:48.259181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-f3484863-923e-4031-83a4-e97f36b10702 req-b48fb38c-4fff-4ecd-817a-14407b065c8b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038796 Sep 24 14:34:48.260355 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 407/811] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:34:48.276107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:48.284758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-32d6876e-8780-4604-a03d-19994565b854 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1755 microversion: 2.1 time: 0.176392 Sep 24 14:34:48.285399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 405/812] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:48 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:49.314263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:49.315091 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:49.322610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:49.323963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:49.324617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:49.325548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:49.326193 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:49.326844 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:49.476531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:49.480022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:49.485479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-02920877-25c2-494b-9d2f-74011b06b522 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1758 microversion: 2.1 time: 0.180722 Sep 24 14:34:49.486037 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 408/813] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:49 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:34:50.068156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:50.068642 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:50.075001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:50.075476 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:50.075901 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:50.076572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:50.077635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:50.078055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:50.103852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Going to try to terminate instance {{(pid=120744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:34:50.177519 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d0c3d27f-1c6c-4eac-ad34-8e03c5f1d57b tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 204 len: 0 microversion: 2.1 time: 0.112939 Sep 24 14:34:50.181263 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 406/814] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:34:50 2022] DELETE /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:34:50.187420 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:50.188246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:50.194258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:50.194743 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:50.195210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:50.195898 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:50.196344 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:50.196765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:50.325701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:50.333198 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b21aa3e1-ffb7-4e03-9457-21122126ed62 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1507 microversion: 2.1 time: 0.150677 Sep 24 14:34:50.333750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 409/815] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:50 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:51.356453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:51.357149 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:51.363587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:51.364071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:51.364504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:51.365189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:51.365639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:51.366058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:51.564912 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:51.576167 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cb720e09-4cfb-4997-b19d-b4a03cb1241f tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 200 len: 1507 microversion: 2.1 time: 0.223807 Sep 24 14:34:51.577994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 407/816] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:51 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:51.623018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e2f4f540-4992-4d40-9978-146e32a47976 req-f6876387-0b46-4ec3-bd25-1b5260ad1844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f95b7f-2918-442c-ba7f-832ba9156e7d", "name": "network-vif-deleted", "tag": "3c943efd-ace2-4916-8133-bc99ff2e01cf"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:51.630991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:51.635681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e2f4f540-4992-4d40-9978-146e32a47976 req-f6876387-0b46-4ec3-bd25-1b5260ad1844 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:51.636154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e2f4f540-4992-4d40-9978-146e32a47976 req-f6876387-0b46-4ec3-bd25-1b5260ad1844 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:51.636582 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e2f4f540-4992-4d40-9978-146e32a47976 req-f6876387-0b46-4ec3-bd25-1b5260ad1844 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:51.650630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e2f4f540-4992-4d40-9978-146e32a47976 req-f6876387-0b46-4ec3-bd25-1b5260ad1844 service nova] Creating event network-vif-deleted:3c943efd-ace2-4916-8133-bc99ff2e01cf for instance c7f95b7f-2918-442c-ba7f-832ba9156e7d on hv-cinder-85919 Sep 24 14:34:51.656414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e2f4f540-4992-4d40-9978-146e32a47976 req-f6876387-0b46-4ec3-bd25-1b5260ad1844 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036903 Sep 24 14:34:51.657008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 410/817] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:52.603613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:52.604155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: c7f95b7f-2918-442c-ba7f-832ba9156e7d] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:52.606519 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:52.611670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:52.612148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:52.612575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:52.613246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:52.613698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:52.614113 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:52.628756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] HTTP exception thrown: Instance c7f95b7f-2918-442c-ba7f-832ba9156e7d could not be found. Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Request method failure captured: Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d HTTP/1.1 Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOLWriOc_fWjMg7Oul8BIvVGCEPFVpXgNIV-7u-wMLixvbrHb_bUysnihGjDt4CFF3vG1rqnqpmblstNQee2vVipwt8X8vMiHZG-diq5X4BiTl8z6Fdl-03MaNfIp0c17eGbTPzRVyT4q6mLcE4jSkRUMGjQzKf5Yisq2smRy8uLOo Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:34:52.630441 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b458789f89a441caad76e78167bc00b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b458789f89a441caad76e78167bc00b"}]}] Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: c3cf8e31062d4bd7bfa76c09e7e2adea Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance c7f95b7f-2918-442c-ba7f-832ba9156e7d could not be found. Sep 24 14:34:52.632049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'c7f95b7f-2918-442c-ba7f-832ba9156e7d'} Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f95b7f-2918-442c-ba7f-832ba9156e7d could not be found. Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:34:52.632968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f95b7f-2918-442c-ba7f-832ba9156e7d could not be found. Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f95b7f-2918-442c-ba7f-832ba9156e7d could not be found. Sep 24 14:34:52.634438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:34:52.635926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Returning 404 to user: Instance c7f95b7f-2918-442c-ba7f-832ba9156e7d could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:34:52.635926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4718091f-fe28-4062-a3f4-f0e94a544f2c tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d" status: 404 len: 111 microversion: 2.1 time: 0.032188 Sep 24 14:34:52.635926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 408/818] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:52 2022] GET /compute/v2.1/servers/c7f95b7f-2918-442c-ba7f-832ba9156e7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:52.641837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:52.642418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:52.648687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:52.649166 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:52.649609 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:52.650285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:52.650736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:52.651181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:52.677349 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:34:52.749656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-174b96b2-c77a-4868-a8ba-88dea689690e tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 204 len: 0 microversion: 2.1 time: 0.112438 Sep 24 14:34:52.750659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 411/819] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:34:52 2022] DELETE /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 14:34:52.759077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:52.759684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:52.766417 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:52.766926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:52.767355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:52.768029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:52.768474 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:52.768890 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:52.895444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:52.902969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f466d7a6-8cd6-4c3f-8bed-79037a4b0678 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.148000 Sep 24 14:34:52.903776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 409/820] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:52 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:53.927345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:53.928119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:53.934652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:53.935252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:53.935763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:53.936587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:53.937111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:53.937543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:54.071368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3cf8e31062d4bd7bfa76c09e7e2adea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b458789f89a441caad76e78167bc00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:34:54.080096 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f078043c-7e21-4588-ad6d-62ac1cc0e2a6 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 200 len: 1520 microversion: 2.1 time: 0.157263 Sep 24 14:34:54.094843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 412/821] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:53 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:34:54.168166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-fe6eb4d2-e95b-415d-9cb4-b06131907344 req-dcb96f34-4401-41e6-8a80-dcb7b4767dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3aab52-9469-4a21-98ba-f83382ebf7ab", "name": "network-vif-deleted", "tag": "812bad02-1d00-421a-acb7-00e2e9023540"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:34:54.175427 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fe6eb4d2-e95b-415d-9cb4-b06131907344 req-dcb96f34-4401-41e6-8a80-dcb7b4767dc0 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:54.175905 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fe6eb4d2-e95b-415d-9cb4-b06131907344 req-dcb96f34-4401-41e6-8a80-dcb7b4767dc0 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:54.176326 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fe6eb4d2-e95b-415d-9cb4-b06131907344 req-dcb96f34-4401-41e6-8a80-dcb7b4767dc0 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:54.187632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-fe6eb4d2-e95b-415d-9cb4-b06131907344 req-dcb96f34-4401-41e6-8a80-dcb7b4767dc0 service nova] Creating event network-vif-deleted:812bad02-1d00-421a-acb7-00e2e9023540 for instance db3aab52-9469-4a21-98ba-f83382ebf7ab on hv-cinder-85919 Sep 24 14:34:54.193852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-fe6eb4d2-e95b-415d-9cb4-b06131907344 req-dcb96f34-4401-41e6-8a80-dcb7b4767dc0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Sep 24 14:34:54.194923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 410/822] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:34:55.104309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:34:55.104869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] [instance: db3aab52-9469-4a21-98ba-f83382ebf7ab] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:34:55.111823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:55.112300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:55.112733 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:55.113412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:34:55.113858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:34:55.114274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:34:55.127278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] HTTP exception thrown: Instance db3aab52-9469-4a21-98ba-f83382ebf7ab could not be found. Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Request method failure captured: Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab HTTP/1.1 Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxOLWriOc_fWjMg7Oul8BIvVGCEPFVpXgNIV-7u-wMLixvbrHb_bUysnihGjDt4CFF3vG1rqnqpmblstNQee2vVipwt8X8vMiHZG-diq5X4BiTl8z6Fdl-03MaNfIp0c17eGbTPzRVyT4q6mLcE4jSkRUMGjQzKf5Yisq2smRy8uLOo Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:34:55.128882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b458789f89a441caad76e78167bc00b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b458789f89a441caad76e78167bc00b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b458789f89a441caad76e78167bc00b"}]}] Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 9b458789f89a441caad76e78167bc00b Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1268506751 Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: c3cf8e31062d4bd7bfa76c09e7e2adea Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1268506751-project Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance db3aab52-9469-4a21-98ba-f83382ebf7ab could not be found. Sep 24 14:34:55.130263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'db3aab52-9469-4a21-98ba-f83382ebf7ab'} Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3aab52-9469-4a21-98ba-f83382ebf7ab could not be found. Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:34:55.131108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3aab52-9469-4a21-98ba-f83382ebf7ab could not be found. Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3aab52-9469-4a21-98ba-f83382ebf7ab could not be found. Sep 24 14:34:55.132651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:34:55.134023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] Returning 404 to user: Instance db3aab52-9469-4a21-98ba-f83382ebf7ab could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:34:55.134023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d53cb041-4a49-4046-9bb8-71d2b8dde006 tempest-ServerRescueNegativeTestJSON-1268506751 tempest-ServerRescueNegativeTestJSON-1268506751-project] 10.222.0.52 "GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab" status: 404 len: 111 microversion: 2.1 time: 0.029928 Sep 24 14:34:55.134023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 413/823] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:34:55 2022] GET /compute/v2.1/servers/db3aab52-9469-4a21-98ba-f83382ebf7ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:35:03.734178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3033fa91-f732-44e5-acc0-577eb8c11b3e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: .version_select at 0x7f222aaa5d30>, body: {"keypair": {"name": "tempest-keypair-1258484243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEWSr14yhYWn1UooonOqYuNNMWKIsrX5bOcEXj++DzgmbWYymKW4SfZ6UURVo1uhmKdpo9RfFuCrXSMOMN35adu5eus58iUGdpGznoyBQfgkfRsGzroqTQfG/BfmRxqnA=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:03.757243 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-3033fa91-f732-44e5-acc0-577eb8c11b3e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:35:03.763120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-3033fa91-f732-44e5-acc0-577eb8c11b3e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:35:03.792103 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3033fa91-f732-44e5-acc0-577eb8c11b3e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218627 Sep 24 14:35:03.792698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 411/824] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:35:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:35:05.341844 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1401481380", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd29c2a7-29a9-46cb-ada7-34fd38591f69"}], "security_groups": [{"name": "tempest-securitygroup--686744716"}], "key_name": "tempest-keypair-1258484243", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:05.350552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:05.351612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:05.448582 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] validate_networks() for [('dd29c2a7-29a9-46cb-ada7-34fd38591f69', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:35:05.819380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:35:05.819802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:35:05.820269 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:35:05.820670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:35:05.822435 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:35:05.841632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:05.842916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:05.843415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:05.844245 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:05.844762 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:05.845246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:05.866329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:35:05.870871 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:35:05.882472 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:35:05.884847 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:35:05.934323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-87f24e06-af19-47fb-86bd-1165f3ca17e9 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.596554 Sep 24 14:35:05.935236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 414/825] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:35:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:35:05.943311 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:05.948247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b1767286-a9ea-4f87-9738-6d4a0aa3896a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:05.948953 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b1767286-a9ea-4f87-9738-6d4a0aa3896a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:06.017865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b1767286-a9ea-4f87-9738-6d4a0aa3896a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:06.025702 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b1767286-a9ea-4f87-9738-6d4a0aa3896a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1242 microversion: 2.1 time: 0.083238 Sep 24 14:35:06.026319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 412/826] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:05 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:07.049586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:07.050129 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:07.057104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:07.057888 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:07.058333 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:07.059252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:07.059885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:07.060314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:07.126069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:07.135160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d6db0b09-d586-4dd0-9077-a3ff79b9af36 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1294 microversion: 2.1 time: 0.090053 Sep 24 14:35:07.136266 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 415/827] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:07 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:08.160221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:08.160979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:08.168211 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:08.168856 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:08.169287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:08.170542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:08.171204 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:08.171781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:08.380896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:08.390658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7993b05b-a46c-416e-9ed1-86c679c9aae3 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.234448 Sep 24 14:35:08.406500 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 413/828] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:08 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:08.703958 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-922b808c-0ec3-410f-9f79-66c9a09f5fbd req-be20b457-ddcf-47c8-8c6d-e1f2c3d0516b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97c9001-9a6b-44d2-bbf3-aca4ea818bbc", "tag": "044af794-88a5-48b6-b924-7e393056241b"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:08.715189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-922b808c-0ec3-410f-9f79-66c9a09f5fbd req-be20b457-ddcf-47c8-8c6d-e1f2c3d0516b service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:08.715595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-922b808c-0ec3-410f-9f79-66c9a09f5fbd req-be20b457-ddcf-47c8-8c6d-e1f2c3d0516b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:08.716151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-922b808c-0ec3-410f-9f79-66c9a09f5fbd req-be20b457-ddcf-47c8-8c6d-e1f2c3d0516b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:08.729300 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-922b808c-0ec3-410f-9f79-66c9a09f5fbd req-be20b457-ddcf-47c8-8c6d-e1f2c3d0516b service nova] Creating event network-changed:044af794-88a5-48b6-b924-7e393056241b for instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc on hv-cinder-85919 Sep 24 14:35:08.734170 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-922b808c-0ec3-410f-9f79-66c9a09f5fbd req-be20b457-ddcf-47c8-8c6d-e1f2c3d0516b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Sep 24 14:35:08.734751 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 416/829] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:35:09.416317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:09.416929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:09.423974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:09.424450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:09.424879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:09.425555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:09.426004 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:09.426424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:09.557050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:09.564572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5709f861-0e18-4d6d-8a62-cddb6ae03202 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.152110 Sep 24 14:35:09.565132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 414/830] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:09 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:10.588593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:10.590087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:10.596648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:10.597127 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:10.597554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:10.598231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:10.598680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:10.599123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:10.735784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:10.743271 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-49447ef3-c06e-4efa-983e-d5cae84c040d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.159579 Sep 24 14:35:10.743826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 417/831] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:10 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:11.766087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:11.766686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:11.773260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:11.773738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:11.774161 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:11.774857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:11.775303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:11.775718 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:12.049628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:12.057127 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-984221fa-092a-41bd-8f51-a45dec7426b4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.295479 Sep 24 14:35:12.057672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 415/832] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:11 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:13.081486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:13.082089 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:13.088526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:13.088944 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:13.089383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:13.090049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:13.090493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:13.090934 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:13.214961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:13.222425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5d3520e9-85ce-4a5c-bab8-fc4aa4a76bbc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.145677 Sep 24 14:35:13.223034 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 418/833] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:13 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:14.245342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:14.245940 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:14.253069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:14.253542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:14.253970 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:14.254637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:14.255110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:14.255525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:14.385147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:14.393291 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6a1be2e8-9bdd-4e8a-bed1-08471c6fcd68 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.152079 Sep 24 14:35:14.393830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 416/834] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:14 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:15.417060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:15.417662 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:15.424665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:15.425140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:15.425568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:15.426245 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:15.426689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:15.427124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:15.559499 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:15.567379 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4ffa996e-a04d-4d39-a808-02f7aa0af85d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.154049 Sep 24 14:35:15.567889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 419/835] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:15 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:35:15.581651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-f5be716e-365c-46a5-834d-0658b2bf37f1 req-b6ccc894-5b0d-43fd-bf15-0e7fbb036338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97c9001-9a6b-44d2-bbf3-aca4ea818bbc", "name": "network-vif-plugged", "status": "completed", "tag": "044af794-88a5-48b6-b924-7e393056241b"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:15.595888 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-f5be716e-365c-46a5-834d-0658b2bf37f1 req-b6ccc894-5b0d-43fd-bf15-0e7fbb036338 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:15.596839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-f5be716e-365c-46a5-834d-0658b2bf37f1 req-b6ccc894-5b0d-43fd-bf15-0e7fbb036338 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:15.597395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-f5be716e-365c-46a5-834d-0658b2bf37f1 req-b6ccc894-5b0d-43fd-bf15-0e7fbb036338 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:15.610499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-f5be716e-365c-46a5-834d-0658b2bf37f1 req-b6ccc894-5b0d-43fd-bf15-0e7fbb036338 service nova] Creating event network-vif-plugged:044af794-88a5-48b6-b924-7e393056241b for instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc on hv-cinder-85919 Sep 24 14:35:15.615336 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-f5be716e-365c-46a5-834d-0658b2bf37f1 req-b6ccc894-5b0d-43fd-bf15-0e7fbb036338 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Sep 24 14:35:15.615902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 417/836] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:35:16.591636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:16.592383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:16.594378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:16.595091 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:16.601917 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:16.602382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:16.602828 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:16.603530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:16.603981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:16.604405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:16.731584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:16.739621 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6370f142-0d09-40af-a515-d03fad24c624 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1367 microversion: 2.1 time: 0.152388 Sep 24 14:35:16.740182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 420/837] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:16 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:17.760381 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:17.765757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:17.766455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:17.772798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:17.773278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:17.773713 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:17.774393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:17.774859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:17.775290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:17.906965 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:35:17.916266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fb19a290-ed75-45a6-a2c4-b9d70f44cc75 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1557 microversion: 2.1 time: 0.156774 Sep 24 14:35:17.922602 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 418/838] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:35:17 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:35:17.941317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:17.941857 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:17.948119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:17.948595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:17.949018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:17.949691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:17.950134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:17.950574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:18.025000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-89650012-b497-4cf0-b9d4-aafd4d2c7521 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087810 Sep 24 14:35:18.025595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 421/839] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:35:17 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:35:18.954386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-2da43fc9-e939-4ff1-b9ef-aff5c4d66242 req-84aa2ed7-d928-452d-9497-8f880d2e81d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97c9001-9a6b-44d2-bbf3-aca4ea818bbc", "tag": "044af794-88a5-48b6-b924-7e393056241b"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:18.964146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-2da43fc9-e939-4ff1-b9ef-aff5c4d66242 req-84aa2ed7-d928-452d-9497-8f880d2e81d7 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:18.964752 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-2da43fc9-e939-4ff1-b9ef-aff5c4d66242 req-84aa2ed7-d928-452d-9497-8f880d2e81d7 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:18.965272 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-2da43fc9-e939-4ff1-b9ef-aff5c4d66242 req-84aa2ed7-d928-452d-9497-8f880d2e81d7 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:18.977673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-2da43fc9-e939-4ff1-b9ef-aff5c4d66242 req-84aa2ed7-d928-452d-9497-8f880d2e81d7 service nova] Creating event network-changed:044af794-88a5-48b6-b924-7e393056241b for instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc on hv-cinder-85919 Sep 24 14:35:18.984606 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-2da43fc9-e939-4ff1-b9ef-aff5c4d66242 req-84aa2ed7-d928-452d-9497-8f880d2e81d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034560 Sep 24 14:35:18.985316 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 419/840] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:35:56.933122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:56.933899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=38 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:56.938553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1451737593"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:56.939115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:56.946733 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:56.947252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:56.947678 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:56.948362 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:56.948808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:56.949225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:57.080765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.network.security_group_api [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Removing security group aea4aecb-ea94-4294-bdda-2433c5abadc6 from port b51d80e5-325c-440f-824b-228eda3d320a Sep 24 14:35:57.379227 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eb01de02-959b-4ea2-88f4-30b80d64fed4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/action" status: 202 len: 0 microversion: 2.1 time: 0.447498 Sep 24 14:35:57.379854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 422/841] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:35:56 2022] POST /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:35:57.385269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:57.386082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=34 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:57.391472 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-8f763e5a-dde4-4ca2-b617-f7c40d51e818 req-d946954a-78dc-4ab3-b6c6-fe759143f75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb8da2f-7b74-42db-a52b-fe358b040633", "tag": "b51d80e5-325c-440f-824b-228eda3d320a"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:57.403489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8f763e5a-dde4-4ca2-b617-f7c40d51e818 req-d946954a-78dc-4ab3-b6c6-fe759143f75e service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:57.403968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8f763e5a-dde4-4ca2-b617-f7c40d51e818 req-d946954a-78dc-4ab3-b6c6-fe759143f75e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:57.404422 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-8f763e5a-dde4-4ca2-b617-f7c40d51e818 req-d946954a-78dc-4ab3-b6c6-fe759143f75e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:57.416109 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-8f763e5a-dde4-4ca2-b617-f7c40d51e818 req-d946954a-78dc-4ab3-b6c6-fe759143f75e service nova] Creating event network-changed:b51d80e5-325c-440f-824b-228eda3d320a for instance fdb8da2f-7b74-42db-a52b-fe358b040633 on hv-cinder-85919 Sep 24 14:35:57.421543 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-8f763e5a-dde4-4ca2-b617-f7c40d51e818 req-d946954a-78dc-4ab3-b6c6-fe759143f75e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037799 Sep 24 14:35:57.422517 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 420/842] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:35:58.502603 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:58.503147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:58.509045 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:58.509520 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:58.509946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:58.510625 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:58.511102 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:58.511519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:58.592022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lazy-loading 'services' on Instance uuid fdb8da2f-7b74-42db-a52b-fe358b040633 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:35:58.666217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ac03bf65-fba4-4072-ac48-d19c8a120f72 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments/c7c25200-b053-4961-a350-6086ce07ba5d" status: 202 len: 0 microversion: 2.1 time: 0.168399 Sep 24 14:35:58.666805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 423/843] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:35:58 2022] DELETE /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments/c7c25200-b053-4961-a350-6086ce07ba5d => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:35:58.677010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:58.679268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:58.686629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:58.687179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:58.687860 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:58.688680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:58.689130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:58.689722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:58.720132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f42bc51f-e80f-4665-8ee6-2a72298f63a4 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047682 Sep 24 14:35:58.720909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 421/844] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:35:58 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:35:59.437610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-854261aa-2170-4525-9619-47a3b163c7ae req-9c28e485-8f45-4b7c-9245-adb8fe3c09a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb8da2f-7b74-42db-a52b-fe358b040633", "tag": "b51d80e5-325c-440f-824b-228eda3d320a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:35:59.447422 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-854261aa-2170-4525-9619-47a3b163c7ae req-9c28e485-8f45-4b7c-9245-adb8fe3c09a8 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:59.447929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-854261aa-2170-4525-9619-47a3b163c7ae req-9c28e485-8f45-4b7c-9245-adb8fe3c09a8 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:59.448370 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-854261aa-2170-4525-9619-47a3b163c7ae req-9c28e485-8f45-4b7c-9245-adb8fe3c09a8 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:59.459711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-854261aa-2170-4525-9619-47a3b163c7ae req-9c28e485-8f45-4b7c-9245-adb8fe3c09a8 service nova] Creating event network-changed:b51d80e5-325c-440f-824b-228eda3d320a for instance fdb8da2f-7b74-42db-a52b-fe358b040633 on hv-cinder-85919 Sep 24 14:35:59.464425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-854261aa-2170-4525-9619-47a3b163c7ae req-9c28e485-8f45-4b7c-9245-adb8fe3c09a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030903 Sep 24 14:35:59.465284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 424/845] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:35:59.733332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:35:59.735613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:35:59.741970 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:59.742552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:59.743091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:59.744106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:35:59.744709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:35:59.745134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:35:59.778397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-039f6f08-4b42-4729-a906-bed5b9fcf34d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049160 Sep 24 14:35:59.782762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 422/846] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:35:59 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:36:00.791881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:00.794088 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:00.800185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:00.800659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:00.801085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:00.801752 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:00.802192 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:00.802605 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:00.832542 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ce24ce42-499e-495b-bf98-1cf2a87c687d tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045365 Sep 24 14:36:00.833119 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 425/847] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:36:00 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:36:00.844337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:00.844841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:00.851854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:00.852391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:00.852790 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:00.853479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:00.853924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:00.854343 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:00.927633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] HTTP exception thrown: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 is not attached to volume c7c25200-b053-4961-a350-6086ce07ba5d Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Request method failure captured: Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments/c7c25200-b053-4961-a350-6086ce07ba5d HTTP/1.1 Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxTPsv1mGEdFNrT4Xf1KiP1ZCQI6XROOJ9FXS1PaPrOTjRj1WIV6UKlclYCmvJs-wqU1UCfvXQwq2MbKnzBpW2sDHQjzsGOZ5xrEPhI2ZVip-NzrlnOUSOgGV2N-pv5H17hoB1kyqZQJ5JEFJDbHU9fcZ-I0LiBOEk6HR5cToqCBOgM Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 8830800be89540929716703bdbb07b13 Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-TestMinimumBasicScenario-937148530 Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:36:00.929991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8830800be89540929716703bdbb07b13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8830800be89540929716703bdbb07b13", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8830800be89540929716703bdbb07b13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8830800be89540929716703bdbb07b13"}]}] Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-TestMinimumBasicScenario-937148530 Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 8830800be89540929716703bdbb07b13 Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-937148530 Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-TestMinimumBasicScenario-937148530-project Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 27724ba162164bbb8faae54388ff11d4 Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-TestMinimumBasicScenario-937148530-project Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:36:00.931672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 is not attached to volume c7c25200-b053-4961-a350-6086ce07ba5d Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'server_id': 'fdb8da2f-7b74-42db-a52b-fe358b040633', 'id': 'c7c25200-b053-4961-a350-6086ce07ba5d'} Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c7c25200-b053-4961-a350-6086ce07ba5d. Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:36:00.932672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 is not attached to volume c7c25200-b053-4961-a350-6086ce07ba5d Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 is not attached to volume c7c25200-b053-4961-a350-6086ce07ba5d Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:00.934162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Returning 404 to user: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 is not attached to volume c7c25200-b053-4961-a350-6086ce07ba5d {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:36:00.935736 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d326b832-ad3c-4d34-9fd3-413f28273a48 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments/c7c25200-b053-4961-a350-6086ce07ba5d" status: 404 len: 154 microversion: 2.1 time: 0.091734 Sep 24 14:36:00.935736 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 423/848] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:36:00 2022] DELETE /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633/os-volume_attachments/c7c25200-b053-4961-a350-6086ce07ba5d => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:36:02.072755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:02.073525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:02.079790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:02.080265 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:02.080694 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:02.081363 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:02.081806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:02.082217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:02.106591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:36:02.178526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bbbb92a3-dc1a-492c-822f-a99711aeeccc tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 204 len: 0 microversion: 2.1 time: 0.109220 Sep 24 14:36:02.179134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 426/849] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:36:02 2022] DELETE /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:36:02.188049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:02.188689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:02.194641 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:02.195147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:02.195579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:02.196260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:02.196710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:02.197130 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:02.323181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:02.331260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c8433946-c8be-4186-b4e0-c047fcdfc947 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1552 microversion: 2.1 time: 0.147236 Sep 24 14:36:02.331810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 424/850] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:02 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:03.355778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:03.356500 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:03.362461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:03.362960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:03.363395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:03.364063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:03.364506 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:03.364923 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:03.489916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:03.497991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-675e339f-fb86-4cc5-82b1-5c5217c786c3 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1552 microversion: 2.1 time: 0.145954 Sep 24 14:36:03.498545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 427/851] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:03 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:04.521813 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:04.522420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:04.529778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:04.530262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:04.530694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:04.531406 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:04.531856 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:04.532276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:04.769373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27724ba162164bbb8faae54388ff11d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8830800be89540929716703bdbb07b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:04.777131 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7809d285-6b95-4f46-861b-b6f06efe6a77 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 200 len: 1552 microversion: 2.1 time: 0.259221 Sep 24 14:36:04.778148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 425/852] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:04 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 1552 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:05.002994 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e1679b3f-73b9-49b2-af32-f6e060bdbc4f req-a39466b1-ba81-42ab-a15e-fee696725000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb8da2f-7b74-42db-a52b-fe358b040633", "name": "network-vif-deleted", "tag": "b51d80e5-325c-440f-824b-228eda3d320a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:05.015772 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e1679b3f-73b9-49b2-af32-f6e060bdbc4f req-a39466b1-ba81-42ab-a15e-fee696725000 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:05.016616 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e1679b3f-73b9-49b2-af32-f6e060bdbc4f req-a39466b1-ba81-42ab-a15e-fee696725000 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:05.017158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e1679b3f-73b9-49b2-af32-f6e060bdbc4f req-a39466b1-ba81-42ab-a15e-fee696725000 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:05.031884 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e1679b3f-73b9-49b2-af32-f6e060bdbc4f req-a39466b1-ba81-42ab-a15e-fee696725000 service nova] Creating event network-vif-deleted:b51d80e5-325c-440f-824b-228eda3d320a for instance fdb8da2f-7b74-42db-a52b-fe358b040633 on hv-cinder-85919 Sep 24 14:36:05.037042 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e1679b3f-73b9-49b2-af32-f6e060bdbc4f req-a39466b1-ba81-42ab-a15e-fee696725000 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043766 Sep 24 14:36:05.037620 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 428/853] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:36:05.800852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:05.801460 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] [instance: fdb8da2f-7b74-42db-a52b-fe358b040633] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:05.807754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:05.808243 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:05.808677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:05.809360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:05.809817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:05.810247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:05.823578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] HTTP exception thrown: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 could not be found. Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Request method failure captured: Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 HTTP/1.1 Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxTPsv1mGEdFNrT4Xf1KiP1ZCQI6XROOJ9FXS1PaPrOTjRj1WIV6UKlclYCmvJs-wqU1UCfvXQwq2MbKnzBpW2sDHQjzsGOZ5xrEPhI2ZVip-NzrlnOUSOgGV2N-pv5H17hoB1kyqZQJ5JEFJDbHU9fcZ-I0LiBOEk6HR5cToqCBOgM Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 8830800be89540929716703bdbb07b13 Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-TestMinimumBasicScenario-937148530 Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:36:05.825102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8830800be89540929716703bdbb07b13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8830800be89540929716703bdbb07b13", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8830800be89540929716703bdbb07b13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8830800be89540929716703bdbb07b13"}]}] Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-TestMinimumBasicScenario-937148530 Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 8830800be89540929716703bdbb07b13 Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-TestMinimumBasicScenario-937148530 Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-TestMinimumBasicScenario-937148530-project Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 27724ba162164bbb8faae54388ff11d4 Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-TestMinimumBasicScenario-937148530-project Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 could not be found. Sep 24 14:36:05.826690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'fdb8da2f-7b74-42db-a52b-fe358b040633'} Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 could not be found. Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:36:05.827557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 could not be found. Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 could not be found. Sep 24 14:36:05.829070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:36:05.834526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Returning 404 to user: Instance fdb8da2f-7b74-42db-a52b-fe358b040633 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:36:05.834526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-88864aae-cf56-4c15-8ac4-12089e367853 tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633" status: 404 len: 111 microversion: 2.1 time: 0.029571 Sep 24 14:36:05.834526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 426/854] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:05 2022] GET /compute/v2.1/servers/fdb8da2f-7b74-42db-a52b-fe358b040633 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:36:05.835643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bb3beb83-e5bd-45aa-95ec-17058fdabd4c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] Calling method '.version_select at 0x7f222aa0a0d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:05.853802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bb3beb83-e5bd-45aa-95ec-17058fdabd4c tempest-TestMinimumBasicScenario-937148530 tempest-TestMinimumBasicScenario-937148530-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-77490988" status: 202 len: 0 microversion: 2.1 time: 0.022200 Sep 24 14:36:05.854287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 429/855] 10.222.0.52 () {58 vars in 1266 bytes} [Sat Sep 24 14:36:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-77490988 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:36:14.862179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:14.863484 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:14.870082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:14.870715 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:14.871266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:14.872087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:14.872630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:14.873147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:14.897941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e472183c-5515-4ca6-9daa-74a7c12051bc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/ips" status: 200 len: 150 microversion: 2.20 time: 0.041575 Sep 24 14:36:14.898505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 427/856] 10.222.0.52 () {60 vars in 1289 bytes} [Sat Sep 24 14:36:14 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:36:16.536163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:16.537580 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:16.541957 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:16.542612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:16.551240 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:16.551734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:16.552181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:16.552923 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:16.553381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:16.554435 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:16.585545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lazy-loading 'flavor' on Instance uuid 7f5ccce1-e66b-43e2-8c6e-60858051435f {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:36:16.676795 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-170ac017-2b8c-46b8-be29-477ead9250ba tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "POST /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f/action" status: 202 len: 0 microversion: 2.1 time: 0.142137 Sep 24 14:36:16.681120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 430/857] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:36:16 2022] POST /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:36:16.686896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:16.688080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:16.694537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:16.695304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:16.695912 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:16.696812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:16.697544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:16.698017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:16.826434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:16.827075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:16.839700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:16.841238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:16.842630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:16.843541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:16.844160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:16.844734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:16.878487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lazy-loading 'flavor' on Instance uuid 3195e775-0693-43e1-98c5-6da051739679 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:36:17.116745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:17.136134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-318ccc64-df40-46cb-aef2-924ec4e88f4d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.453390 Sep 24 14:36:17.138008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 428/858] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:16 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:17.340249 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e1b5d920-4ea1-4bdb-94ff-6b2c5d1a8fd1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/action" status: 202 len: 0 microversion: 2.20 time: 0.517792 Sep 24 14:36:17.350634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:17.351567 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:17.362164 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 431/859] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 14:36:16 2022] POST /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 24 14:36:17.365630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:17.366132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:17.366576 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:17.367314 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:17.368046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:17.368880 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:17.582281 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:17.590781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:17.592412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:17.593648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a64d0816-5d02-4eb3-8a5c-82c0fc86c1ba tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.247210 Sep 24 14:36:17.606689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 429/860] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:17 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:18.166981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:18.168317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:18.176879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:18.177915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:18.178658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:18.179850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:18.180574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:18.181232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:18.353372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:18.363108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3511756b-c67d-4369-9c06-18433dfd98df tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.201911 Sep 24 14:36:18.373569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 432/861] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:18 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:18.618839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:18.619525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:18.626077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:18.626569 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:18.627047 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:18.627745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:18.628372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:18.628962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:18.779965 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:18.788703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:18.790151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:18.791527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ffa7568c-9a7e-4d74-b85b-82a210a116cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.176567 Sep 24 14:36:18.792090 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 430/862] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:18 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:19.408006 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:19.409243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:19.416153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:19.416979 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:19.417644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:19.418500 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:19.419486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:19.420133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:19.578512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:19.586865 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-943aceed-5f14-4cd3-ab0f-da4bcbe2edbb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.201740 Sep 24 14:36:19.588190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 433/863] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:19 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:19.835986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:19.836613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:19.844611 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 14:36:19.845013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Sat Sep 24 14:36:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 (ip 10.222.0.52) !!! Sep 24 14:36:19.847066 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:19.850333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:19.853399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:19.854718 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:19.855925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:19.858259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:20.112282 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:20.133661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:20.135814 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:20.137375 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-38bb9eae-db47-4398-80e0-e370dc0e056b tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.315563 Sep 24 14:36:20.138578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 431/864] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:19 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:20.612879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:20.613487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:20.622146 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:20.622628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:20.627494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:20.628770 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:20.629247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:20.629729 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:20.884377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:20.919361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fec58960-8248-4073-ace2-6dca76593f8a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.309970 Sep 24 14:36:20.925334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 434/865] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:20 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:21.164261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:21.165688 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:21.204339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:21.219661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:21.220649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:21.221932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:21.222779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:21.231612 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:21.409309 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:21.419531 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:21.422791 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:21.424852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-200b5cb2-fd7d-4257-a4b2-a199f56fbbf3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.264274 Sep 24 14:36:21.426864 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 432/866] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:21 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:21.945531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:21.946001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:21.956295 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:21.956779 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:21.961044 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:21.961990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:21.964813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:21.969315 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:22.178883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:22.205195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2ed2e3ec-758a-4967-93e7-1563c534e00d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.264038 Sep 24 14:36:22.205903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 435/867] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:21 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:22.918580 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:22.919782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:22.927764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:22.928259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:22.928938 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:22.929582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:22.930045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:22.930473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:23.232092 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:23.233833 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:23.241535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:23.242200 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:23.242844 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:23.244382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:23.244866 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:23.245434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:23.264361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:23.279416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:23.281558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:23.283174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-733714de-975f-48f6-8d04-432404adfeeb tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.835629 Sep 24 14:36:23.285787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 433/868] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:22 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:23.397252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:23.406302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-27159d4b-155c-4ec4-a687-a6a978ab8e37 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.178715 Sep 24 14:36:23.407118 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 436/869] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:23 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:36:24.043996 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1b687d1e-0a23-44d9-b370-1582eda7152a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Action: 'create', calling method: .version_select at 0x7f222e197c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2083695467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIs05rvGzWSuSojVhEj/fFVWIahY/wR3BhQDuJwf21A91BdNXE/x/6CNtyD5RgDMF+SYPjmwF9Xf2lqZEOkl/QKgWZXQIy+q3WcQteX4g9Jv2CmUNtLZkReOD0R7vQ02w=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:24.060778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-1b687d1e-0a23-44d9-b370-1582eda7152a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:36:24.066160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-1b687d1e-0a23-44d9-b370-1582eda7152a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for user ffe9a464991e4965a0638d0c23b17ae7 and project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:36:24.099670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1b687d1e-0a23-44d9-b370-1582eda7152a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.157070 Sep 24 14:36:24.100368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 434/870] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:36:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:36:24.310153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:24.310766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:24.316916 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:24.317400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:24.317856 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:24.318541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:24.319015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:24.319437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:24.435564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:24.436870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:24.445713 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:24.446555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:24.447224 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:24.448094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:24.448716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:24.449418 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:24.513693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:24.531980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:24.533959 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:24.535625 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f460d849-96f7-4269-91e2-09e6a1d1ac86 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.229580 Sep 24 14:36:24.536433 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 437/871] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:24 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:36:24.807941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:24.817763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-faf181ad-8969-4dd8-b41c-dc46cf38ade6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.391877 Sep 24 14:36:24.819469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 435/872] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:24 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:25.560882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:25.561493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:25.569825 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:25.570416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:25.571142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:25.571966 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:25.572489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:25.573165 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:25.722277 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:25.732393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:25.733838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:25.735092 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a42d2fea-71d1-492d-97ae-fae160784944 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.178637 Sep 24 14:36:25.735954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 438/873] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:25 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:25.846510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:25.847401 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:25.853490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:25.853973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:25.854406 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:25.855126 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:25.855619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:25.856659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:25.988562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:25.996902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5584744b-1ad9-4cdb-ac7b-cbb3f7fdebbe tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.154429 Sep 24 14:36:25.997463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 436/874] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:25 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:26.760797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:26.761404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:26.767895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:26.768380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:26.768811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:26.769488 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:26.769932 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:26.770372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:26.916555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:26.929136 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:26.930596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:26.931810 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0862caae-f776-4167-971b-f391ad8ea781 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.174983 Sep 24 14:36:26.932445 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 439/875] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:26 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:27.021520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:27.022724 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:27.032019 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:27.032508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:27.033109 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:27.034023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:27.034674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:27.035249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:27.244631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:27.257156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d4804925-7a7e-4ab2-9e15-36034f54c2d7 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.239781 Sep 24 14:36:27.257733 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 437/876] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:27 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:27.958174 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:27.958782 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:27.966999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:27.967489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:27.967925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:27.968651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:27.969102 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:27.969523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:28.128610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:28.137954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:28.139483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:28.140670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2fa7793b-e816-4253-95a1-d1563af2aaa6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.186524 Sep 24 14:36:28.141205 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 440/877] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:27 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:28.282686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:28.283320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:28.285917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:28.291956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:28.292475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:28.292904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:28.294188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:28.294634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:28.295075 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:28.298589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=93 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:28.458228 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:28.469513 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5d21dbc1-8a35-49f9-aea2-5dd6156b5d78 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.190843 Sep 24 14:36:28.486290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 438/878] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:28 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:29.169859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:29.170635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:29.177323 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:29.177813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:29.178252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:29.178983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:29.179443 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:29.179867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:29.325241 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:29.333414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:29.334895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:29.336077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-527ddb11-15d3-4dd9-a15a-5f5b17b0ba16 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.171726 Sep 24 14:36:29.336631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 441/879] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:29 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:29.493609 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:29.494135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:29.501180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:29.501656 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:29.502082 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:29.502757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:29.503231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:29.503651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:29.654179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:29.662593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3336ebe5-57c9-4f86-8011-fd0332c03886 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.172879 Sep 24 14:36:29.663201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 439/880] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:29 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:30.360553 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:30.361154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:30.367504 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.367979 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.368413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:30.369086 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.369528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.369941 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:30.388828 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:30.505260 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:30.516324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:30.517766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:30.518961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-90a891fc-f0d3-4b87-806d-6c542c945f04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1742 microversion: 2.20 time: 0.162271 Sep 24 14:36:30.519509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 442/881] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:30 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:30.687227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:30.687837 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:30.694181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.694667 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.695128 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:30.695879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.696400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.696828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:30.830792 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:30.840822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7e6fec92-8430-4ef0-bde1-e8162192d856 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1510 microversion: 2.1 time: 0.157546 Sep 24 14:36:30.841394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 440/882] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:30 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:36:30.864640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:30.865340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:30.872243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.872731 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.873169 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:30.873869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.874402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.875140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:30.904901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120743) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 14:36:30.973688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ca3458b7-3136-4a60-a495-e8cfb3ac3819 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "POST /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f/action" status: 202 len: 0 microversion: 2.1 time: 0.113894 Sep 24 14:36:30.974339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 443/883] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:36:30 2022] POST /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:36:30.983360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:30.984058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:30.991070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.991989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.992506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:30.993522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:30.993984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:30.994477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:31.151958 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:31.160215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f883be24-d06c-48f5-85f4-7c4a6bb7159f tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1518 microversion: 2.1 time: 0.181636 Sep 24 14:36:31.160698 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 441/884] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:30 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:31.545818 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:31.546421 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:31.553945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:31.555652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:31.556254 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:31.557738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:31.558543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:31.559078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:31.694131 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:31.702937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:31.704376 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:31.705519 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8e5f16be-fec0-4c32-a357-906aeb8b5700 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1742 microversion: 2.20 time: 0.164401 Sep 24 14:36:31.706159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 444/885] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:31 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:32.184349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:32.185547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:32.192625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:32.193095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:32.193530 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:32.194221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:32.194947 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:32.195556 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:32.347728 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:32.356292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5bc0a733-5f95-461c-b319-44a80424fcc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1520 microversion: 2.1 time: 0.176103 Sep 24 14:36:32.356858 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 442/886] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:32 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:32.733264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:32.733863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:32.740254 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:32.740734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:32.741167 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:32.741850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:32.742298 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:32.742716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:32.874405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:32.882405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:32.883896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:32.885055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5b54d23b-6638-4fcc-9386-6c7e5f4600aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1742 microversion: 2.20 time: 0.156285 Sep 24 14:36:32.885605 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 445/887] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:32 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:33.379814 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:33.380450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:33.386692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:33.387743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:33.388177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:33.388894 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:33.389346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:33.389768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:33.847588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:33.855236 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-89b96445-a953-4ec0-b584-bcd07445a0d9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.479362 Sep 24 14:36:33.856510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 443/888] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:33 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:33.912274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:33.912884 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:33.919329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:33.919820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:33.920262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:33.920955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:33.921415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:33.921849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:34.057025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:34.065060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:34.066512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:34.068141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d6358625-0418-46fb-b084-601241ed5ffc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1742 microversion: 2.20 time: 0.159954 Sep 24 14:36:34.068710 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 446/889] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:33 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:34.250478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-33785e62-51cf-4537-a296-dfdbfdffa5df req-017f56d7-84e9-4c68-879b-4c2e26a923ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195e775-0693-43e1-98c5-6da051739679", "name": "network-vif-plugged", "status": "completed", "tag": "9bcbf202-4cbf-42d4-9889-2c337cd6d929"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:34.257371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=4 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:34.266119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-33785e62-51cf-4537-a296-dfdbfdffa5df req-017f56d7-84e9-4c68-879b-4c2e26a923ae service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:34.266606 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-33785e62-51cf-4537-a296-dfdbfdffa5df req-017f56d7-84e9-4c68-879b-4c2e26a923ae service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:34.267087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-33785e62-51cf-4537-a296-dfdbfdffa5df req-017f56d7-84e9-4c68-879b-4c2e26a923ae service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:34.279051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-33785e62-51cf-4537-a296-dfdbfdffa5df req-017f56d7-84e9-4c68-879b-4c2e26a923ae service nova] Creating event network-vif-plugged:9bcbf202-4cbf-42d4-9889-2c337cd6d929 for instance 3195e775-0693-43e1-98c5-6da051739679 on hv-cinder-85919 Sep 24 14:36:34.284094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-33785e62-51cf-4537-a296-dfdbfdffa5df req-017f56d7-84e9-4c68-879b-4c2e26a923ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037489 Sep 24 14:36:34.284852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 444/890] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:36:34.879892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:34.880521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:34.888121 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:34.888613 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:34.889047 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:34.889782 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:34.890234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:34.890658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:35.021530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:35.029437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-728d8411-490e-4dfd-a7c0-6a4e4c2ca090 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.153860 Sep 24 14:36:35.029992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 447/891] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:34 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:35.101058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:35.101778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:35.108383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:35.108857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:35.109286 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:35.109966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:35.110411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:35.110844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:35.239660 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:35.248178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:35.249664 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:35.250895 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e88223c9-03fb-4e7c-aa70-4d0f6ecd6186 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1742 microversion: 2.20 time: 0.154616 Sep 24 14:36:35.251450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 445/892] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:35 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:36.052688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:36.053237 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:36.059554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:36.060029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:36.060456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:36.061128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:36.061575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:36.061997 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:36.198776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:36.207459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5c021507-ee2a-4204-9433-0a620d5c45ef tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.158724 Sep 24 14:36:36.208049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 448/893] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:36 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:36.276148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:36.276746 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:36.283444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:36.283924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:36.284355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:36.285032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:36.285483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:36.285905 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:36.311302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-67b979a5-c265-4df6-b420-221b7ef79e4c req-80cb49ff-331f-4ac1-9415-c68cb9d1bd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5ccce1-e66b-43e2-8c6e-60858051435f", "name": "network-vif-unplugged", "status": "completed", "tag": "22fef065-180c-4fb8-a36d-5b7d245d2726"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:36.321028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-67b979a5-c265-4df6-b420-221b7ef79e4c req-80cb49ff-331f-4ac1-9415-c68cb9d1bd71 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:36.321511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-67b979a5-c265-4df6-b420-221b7ef79e4c req-80cb49ff-331f-4ac1-9415-c68cb9d1bd71 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:36.321943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-67b979a5-c265-4df6-b420-221b7ef79e4c req-80cb49ff-331f-4ac1-9415-c68cb9d1bd71 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:36.334042 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-67b979a5-c265-4df6-b420-221b7ef79e4c req-80cb49ff-331f-4ac1-9415-c68cb9d1bd71 service nova] Creating event network-vif-unplugged:22fef065-180c-4fb8-a36d-5b7d245d2726 for instance 7f5ccce1-e66b-43e2-8c6e-60858051435f on hv-cinder-85919 Sep 24 14:36:36.339973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-67b979a5-c265-4df6-b420-221b7ef79e4c req-80cb49ff-331f-4ac1-9415-c68cb9d1bd71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032794 Sep 24 14:36:36.340703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 449/894] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:36:36.417098 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:36.428060 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:36.429562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:36.430772 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cc9d2d59-c9ff-446d-834b-fab0a99e30df tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1742 microversion: 2.20 time: 0.158481 Sep 24 14:36:36.431369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 446/895] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:36 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:37.231725 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:37.232408 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:37.239182 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:37.239656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:37.240084 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:37.240753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:37.241199 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:37.241614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:37.373498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:37.381093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5b122c1f-9cee-40ce-af7d-bee8e6e5c5b4 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.154242 Sep 24 14:36:37.381647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 450/896] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:37 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:37.461196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:37.461863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:37.468782 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:37.469266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:37.469694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:37.470383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:37.470859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:37.471292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:37.597606 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:37.605482 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:37.606958 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:37.608095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-65ccd9e3-f32a-4311-8729-f816a87967c6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1742 microversion: 2.20 time: 0.150843 Sep 24 14:36:37.608634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 447/897] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:37 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:38.406056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:38.406786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:38.417794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:38.422409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:38.422980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:38.423771 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:38.424316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:38.424806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:38.562730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:38.571630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5b28aef5-06ed-48ea-9d80-fc18f7fe7679 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.170332 Sep 24 14:36:38.576926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 451/898] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:38 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:38.633667 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:38.634267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:38.640994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:38.641484 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:38.641919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:38.642631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:38.643111 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:38.643533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:38.790848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:38.800140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:38.801581 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:38.802751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9a1fbbc9-0ca4-45f8-a0eb-3d4d0aa10798 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.173043 Sep 24 14:36:38.803357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 448/899] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:38 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:39.600210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:39.601156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:39.608686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:39.609296 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:39.609982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:39.610975 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:39.611437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:39.612151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:39.768409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:39.776354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3111b986-260f-4437-9b6c-c44d06d2fa38 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.181745 Sep 24 14:36:39.776910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 452/900] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:39 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:39.845467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:39.846655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:39.853262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:39.853797 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:39.854226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:39.854934 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:39.855381 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:39.856088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:40.013920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:40.022479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:40.024255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:40.025681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f08784f2-a767-4271-8b5c-5062118c5127 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.186933 Sep 24 14:36:40.026546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 449/901] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:39 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:36:40.801924 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:40.802788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:40.809683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:40.810166 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:40.810768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:40.811802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:40.812680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:40.813041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:40.973266 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:40.983967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-88832891-cc74-4f1d-8eb7-2473b6a11114 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.186249 Sep 24 14:36:40.986869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 453/902] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:40 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:41.064430 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:41.065176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:41.071118 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:41.071601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:41.072026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:41.072710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:41.073158 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:41.073579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:41.207743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:41.216630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:41.218094 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:41.219377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b17862ad-ff15-4243-a5ea-4b7b8c6daf8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.159691 Sep 24 14:36:41.219965 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 450/903] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:41 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:42.007491 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:42.008027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:42.017011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:42.017494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:42.017925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:42.018607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:42.019211 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:42.019631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:42.158631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:42.168206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bbe63dfe-298f-47f8-ad78-c8846f7060db tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.164988 Sep 24 14:36:42.168771 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 454/904] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:42 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:42.245241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:42.245845 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:42.252815 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:42.253985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:42.255044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:42.256728 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:42.257738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:42.258651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:42.407032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:42.415067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:42.416573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:42.417973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1bd028bd-6abb-4658-88e9-9e3b61f518fe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.176867 Sep 24 14:36:42.418553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 451/905] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:42 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:43.193040 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:43.193691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:43.203428 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:43.204284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:43.205158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:43.206806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:43.207552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:43.208217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:43.361233 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:43.369763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-50e07a77-8ea7-4624-91c8-51f4381a5a3a tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.181331 Sep 24 14:36:43.383248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 455/906] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:43 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:43.445614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:43.446172 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:43.453086 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:43.453590 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:43.454134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:43.454879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:43.455327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:43.455746 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:43.666048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:43.674689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:43.676173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:43.677320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3957a139-b099-4d05-ad7b-d2eee711873e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.236536 Sep 24 14:36:43.677870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 452/907] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:43 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:44.392332 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:44.392946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:44.399411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:44.399893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:44.400326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:44.401009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:44.401459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:44.401880 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:44.551070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:44.559159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eea71605-d6ce-415c-9af1-db8bde01453d tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.170635 Sep 24 14:36:44.559720 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 456/908] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:44 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:44.703097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:44.703634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:44.710963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:44.711439 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:44.711866 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:44.712540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:44.713337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:44.713755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:44.847735 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:44.856985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:44.858490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:44.859672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2357ae6c-c29a-40ef-aa64-8c5e15fff6c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.161320 Sep 24 14:36:44.860690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 453/909] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:44 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:45.582753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:45.583381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:45.589852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:45.590313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:45.590754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:45.591453 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:45.591901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:45.592322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:45.755867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:45.764039 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-64f8a553-0765-41ea-85f1-195d3612997c tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1576 microversion: 2.1 time: 0.184963 Sep 24 14:36:45.764614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 457/910] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:45 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:45.887311 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:45.888151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:45.894527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:45.895111 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:45.895630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:45.896398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:45.896920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:45.897408 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:46.042165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:46.051146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:46.052604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:46.053765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fdd5a643-7250-4b8a-943d-a7a7e7075c05 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.170473 Sep 24 14:36:46.054322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 454/911] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:45 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:46.787911 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:46.788521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:46.795058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:46.796628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:46.797313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:46.797914 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:46.798765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:46.799465 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:46.799891 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:46.937334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:46.940729 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:46.946159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-555e1783-49f8-441a-971e-da2c297afced tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1563 microversion: 2.1 time: 0.162113 Sep 24 14:36:46.947104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 458/912] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:46 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:47.080143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:47.082330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:47.091655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:47.092069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:47.092553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:47.093234 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:47.093859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:47.094274 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:47.110257 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:47.241208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:47.252813 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:47.254239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:47.255454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5977010c-7d23-4c5f-826f-7d62c6664cd5 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.179597 Sep 24 14:36:47.261143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 455/913] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:47 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:48.283761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:48.284354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:48.292392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:48.293759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:48.294371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:48.295273 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:48.296456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:48.296968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:48.316347 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-facbe5ee-1177-4af8-9eac-6eff43aaa1a7 req-ae1853c2-500c-4d92-9dc1-212518fe479d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5ccce1-e66b-43e2-8c6e-60858051435f", "name": "network-vif-plugged", "status": "completed", "tag": "22fef065-180c-4fb8-a36d-5b7d245d2726"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:48.328352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-facbe5ee-1177-4af8-9eac-6eff43aaa1a7 req-ae1853c2-500c-4d92-9dc1-212518fe479d service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:48.329236 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-facbe5ee-1177-4af8-9eac-6eff43aaa1a7 req-ae1853c2-500c-4d92-9dc1-212518fe479d service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:48.330026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-facbe5ee-1177-4af8-9eac-6eff43aaa1a7 req-ae1853c2-500c-4d92-9dc1-212518fe479d service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:48.347620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-facbe5ee-1177-4af8-9eac-6eff43aaa1a7 req-ae1853c2-500c-4d92-9dc1-212518fe479d service nova] Creating event network-vif-plugged:22fef065-180c-4fb8-a36d-5b7d245d2726 for instance 7f5ccce1-e66b-43e2-8c6e-60858051435f on hv-cinder-85919 Sep 24 14:36:48.353574 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-facbe5ee-1177-4af8-9eac-6eff43aaa1a7 req-ae1853c2-500c-4d92-9dc1-212518fe479d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041857 Sep 24 14:36:48.354949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 456/914] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:36:48.448075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:48.456569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:48.458019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:48.459202 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2ae2d174-e483-4364-9e60-18352c979463 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.179412 Sep 24 14:36:48.459758 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 459/915] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:48 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:49.486104 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:49.487511 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:49.494598 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:49.495342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:49.496095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:49.497048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:49.497835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:49.498494 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:49.636445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:49.653811 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:49.655463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:49.656712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-bc19d295-d710-4125-9e16-cb06501c0622 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.174948 Sep 24 14:36:49.657273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 457/916] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:49 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:50.385708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-316123839", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2083695467", "security_groups": [{"name": "tempest-secgroup-smoke-1381824746"}], "block_device_mapping_v2": [{"uuid": "f0998fd9-566e-4cb5-9cbc-80112916f8d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48c641d5-f10b-46bc-b665-df597be281fe"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:50.525719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] validate_networks() for [('48c641d5-f10b-46bc-b665-df597be281fe', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:36:50.681468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:50.682071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:50.692305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:50.693155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:50.693855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:50.694784 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:50.695526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:50.696171 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:50.852259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:50.863853 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:50.865487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:50.867178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-89f8bf8a-4418-495c-b4fe-a4f2ac2a725d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.189368 Sep 24 14:36:50.868383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 458/917] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:50 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:36:50.978500 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:36:50.978954 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:36:50.979430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:36:50.979838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:36:50.980642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:36:50.990032 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:50.990634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:50.991194 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:50.992281 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:50.992945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:50.993596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:51.012727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:36:51.016946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for user ffe9a464991e4965a0638d0c23b17ae7 and project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:36:51.080613 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:36:51.083010 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0998fd9-566e-4cb5-9cbc-80112916f8d7',volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:36:51.228223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8f07080c-7fda-443f-bc0e-b1ac3c5cd8a7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.846977 Sep 24 14:36:51.238877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 460/918] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:36:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:36:51.241378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-00c73cbc-2b89-4459-bdeb-d657921e5158 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:51.242075 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-00c73cbc-2b89-4459-bdeb-d657921e5158 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:51.311828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-00c73cbc-2b89-4459-bdeb-d657921e5158 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:51.321955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-00c73cbc-2b89-4459-bdeb-d657921e5158 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1094 microversion: 2.1 time: 0.084687 Sep 24 14:36:51.323162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 459/919] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:51 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:36:51.894011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:51.894626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:51.902449 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:51.903339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:51.904324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:51.905077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:51.905577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:51.906258 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:52.089396 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:52.098232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:52.100002 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:52.101255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-45a2225b-476d-4afa-88f1-4cd2e3790441 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.211154 Sep 24 14:36:52.101889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 461/920] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:51 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:52.345444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:52.346076 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:52.355492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:52.356828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:52.357264 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:52.358274 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:52.358589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:52.358999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:52.420921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:52.428507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-37c0e731-5cb8-4364-9f3d-8cf399e461f1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1192 microversion: 2.1 time: 0.087008 Sep 24 14:36:52.429052 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 460/921] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:52 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:53.128154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:53.128689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:53.135076 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:53.135565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:53.136003 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:53.137655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:53.138107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:53.138530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:53.280813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:53.288750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:53.290226 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:53.291402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fd4e82b7-3b1d-4a8c-ba28-3973d45ef501 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1737 microversion: 2.20 time: 0.167258 Sep 24 14:36:53.291958 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 462/922] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:53 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:53.451947 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:53.452710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:53.459464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:53.460045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:53.460547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:53.461482 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:53.462023 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:53.462661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:53.565794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:53.574133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-140f27d6-1708-4435-a639-40ca7dbbebf1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1200 microversion: 2.1 time: 0.126081 Sep 24 14:36:53.574956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 461/923] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:53 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1200 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:54.318895 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:54.320454 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:54.327578 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:54.328066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:54.328689 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:54.329396 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:54.333851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:54.334356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:54.474712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:54.483128 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:54.484577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:54.485770 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-19f17f55-d695-49a3-96b7-30f25a64ab3c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1719 microversion: 2.20 time: 0.171433 Sep 24 14:36:54.486329 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 463/924] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:54 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:36:54.597755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:54.599205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:54.607031 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:54.607525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:54.607961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:54.608693 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:54.609147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:54.609572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:54.742376 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:54.752270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0b1851bb-7b09-47a8-810b-1896c3ec079d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.158648 Sep 24 14:36:54.752848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 462/925] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:54 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:55.511714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:55.512345 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:55.518636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:55.519152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:55.519588 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:55.520265 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:55.520714 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:55.521135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:55.650484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:55.663647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:55.665456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:55.666649 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-98e6208a-bdc5-42c1-87b3-b32456c0f9ec tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1719 microversion: 2.20 time: 0.158783 Sep 24 14:36:55.667260 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 464/926] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:55 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:55.775221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:55.775841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:55.782945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:55.783427 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:55.783859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:55.784541 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:55.784991 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:55.785410 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:55.912694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:55.920974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c7b8e7c6-d015-4f08-ac6b-e4f612039837 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.149607 Sep 24 14:36:55.921562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 463/927] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:55 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:56.430808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-578597c3-c90b-4b77-aba6-b8011238f7c5 req-88e1e8eb-a8f0-47a3-b902-aaecd9324af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195e775-0693-43e1-98c5-6da051739679", "name": "network-vif-unplugged", "status": "completed", "tag": "9bcbf202-4cbf-42d4-9889-2c337cd6d929"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:56.447795 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-578597c3-c90b-4b77-aba6-b8011238f7c5 req-88e1e8eb-a8f0-47a3-b902-aaecd9324af9 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.448837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-578597c3-c90b-4b77-aba6-b8011238f7c5 req-88e1e8eb-a8f0-47a3-b902-aaecd9324af9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.449968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-578597c3-c90b-4b77-aba6-b8011238f7c5 req-88e1e8eb-a8f0-47a3-b902-aaecd9324af9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:56.464215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-578597c3-c90b-4b77-aba6-b8011238f7c5 req-88e1e8eb-a8f0-47a3-b902-aaecd9324af9 service nova] Creating event network-vif-unplugged:9bcbf202-4cbf-42d4-9889-2c337cd6d929 for instance 3195e775-0693-43e1-98c5-6da051739679 on hv-cinder-85919 Sep 24 14:36:56.470631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-578597c3-c90b-4b77-aba6-b8011238f7c5 req-88e1e8eb-a8f0-47a3-b902-aaecd9324af9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047210 Sep 24 14:36:56.471507 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 465/928] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:36:56.694065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:56.694906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:56.702161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.702922 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.703434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:56.704992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.705626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.706055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:56.714198 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-9082b44f-6f65-4a38-a88b-fe667e0bb824 req-ffad8fa5-c3bb-48c5-933f-f400e2febe83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706136cf-b0bb-4a89-951d-a22ef9428b0b", "tag": "bd613a7c-65b3-44db-ac85-45e7485d8eab"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:56.724102 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-9082b44f-6f65-4a38-a88b-fe667e0bb824 req-ffad8fa5-c3bb-48c5-933f-f400e2febe83 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.724586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-9082b44f-6f65-4a38-a88b-fe667e0bb824 req-ffad8fa5-c3bb-48c5-933f-f400e2febe83 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.725014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-9082b44f-6f65-4a38-a88b-fe667e0bb824 req-ffad8fa5-c3bb-48c5-933f-f400e2febe83 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:56.736393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-9082b44f-6f65-4a38-a88b-fe667e0bb824 req-ffad8fa5-c3bb-48c5-933f-f400e2febe83 service nova] Creating event network-changed:bd613a7c-65b3-44db-ac85-45e7485d8eab for instance 706136cf-b0bb-4a89-951d-a22ef9428b0b on hv-cinder-85919 Sep 24 14:36:56.741261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-9082b44f-6f65-4a38-a88b-fe667e0bb824 req-ffad8fa5-c3bb-48c5-933f-f400e2febe83 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090406 Sep 24 14:36:56.742147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 464/929] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:36:56.842180 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:56.850762 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:56.852334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:56.853529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-77ee3bfe-4a55-477f-b54d-024ba3ee9ff0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1722 microversion: 2.20 time: 0.163694 Sep 24 14:36:56.854116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 466/930] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:56 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:36:56.883786 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64128e6c-0875-44b9-a5f8-a2dd5cbd2c45"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:56.886242 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:56.892852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.893332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.893767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:56.894445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.894955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.895377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:56.949253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:56.950393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:56.963121 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.963650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.966324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:56.970253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:56.971006 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:56.971611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:57.127865 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:57.137420 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-81152070-ee8a-428e-b027-a35273126702 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.192715 Sep 24 14:36:57.138027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 467/931] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:56 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:57.198655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6f89884d-cbf4-4c82-bb23-a17b674274ac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319619 Sep 24 14:36:57.199827 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 465/932] 10.222.0.52 () {62 vars in 1364 bytes} [Sat Sep 24 14:36:56 2022] POST /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:36:57.324346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:57.324837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:57.330899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:57.331383 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:57.331829 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:57.332504 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:57.332962 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:57.333670 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:57.592701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8ea33951-0340-4b71-9cf5-39dd2dc26dfe tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-volume_attachments/64128e6c-0875-44b9-a5f8-a2dd5cbd2c45" status: 202 len: 0 microversion: 2.20 time: 0.272267 Sep 24 14:36:57.593363 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 468/933] 10.222.0.52 () {60 vars in 1457 bytes} [Sat Sep 24 14:36:57 2022] DELETE /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-volume_attachments/64128e6c-0875-44b9-a5f8-a2dd5cbd2c45 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:36:57.656346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:36:57.656966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:57.663423 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:57.663953 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:57.664411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:57.665179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:57.665605 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:57.666061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:57.714562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120744) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 14:36:57.786682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-36e3db9d-c5e3-400f-85d1-5c007880a889 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "POST /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/action" status: 202 len: 0 microversion: 2.20 time: 0.135212 Sep 24 14:36:57.787324 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 466/934] 10.222.0.52 () {62 vars in 1319 bytes} [Sat Sep 24 14:36:57 2022] POST /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:36:57.795832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:57.797017 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:57.804746 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:57.805757 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:57.806311 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:57.807430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:57.808015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:57.808628 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:57.958434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:57.967191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:57.968709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:57.969957 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4f760a7a-1a2d-41ce-ae1e-5d54207f6879 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1670 microversion: 2.20 time: 0.178521 Sep 24 14:36:57.970589 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 469/935] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:57 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:58.159136 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:58.160121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:58.167667 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:58.168153 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:58.168582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:58.169268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:58.169714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:58.170135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:58.306176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:58.314370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2cd13f20-3560-4028-af56-6e7638df2109 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.159172 Sep 24 14:36:58.314955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 467/936] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:58 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:36:58.994837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:58.995450 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:59.002275 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:59.002790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:59.003421 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:59.004132 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:59.004574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:59.005187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:59.147187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:59.156140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:59.157570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:59.158737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ffbe603f-4b7d-4075-8b21-85e4e3d4eaac tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.167789 Sep 24 14:36:59.159314 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 470/937] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:36:58 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:36:59.337341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:36:59.337904 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:36:59.340981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:59.346160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:59.346635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:59.347095 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:59.347777 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:36:59.348228 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:36:59.348648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:36:59.510031 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:36:59.518332 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d1cbde23-a380-4e58-8e1a-cb857a4a4dff tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.184874 Sep 24 14:36:59.519213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 468/938] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:36:59 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:00.184991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:00.185683 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:00.192295 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:00.192813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:00.193252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:00.193974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:00.194507 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:00.194965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:00.327844 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:00.335903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:00.337344 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:00.338488 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-08ad95b7-fb51-4dbe-b0ef-1ff771d1b7aa tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.158021 Sep 24 14:37:00.339075 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 471/939] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:00 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:00.541931 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:00.542568 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:00.549763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:00.550533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:00.551088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:00.552021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:00.552704 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:00.553335 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:00.725318 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:00.733786 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-99b014eb-a752-41c1-b78f-e3a8d49d2a63 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.195902 Sep 24 14:37:00.734487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 469/940] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:00 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:01.132179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:01.132671 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:01.135807 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:01.136459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:01.140948 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:01.141502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:01.141935 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:01.142633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:01.143122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:01.143549 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:01.169256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3a16cf2d-64d9-4fd7-9e3c-ebe4a121ca80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/ips" status: 200 len: 149 microversion: 2.1 time: 0.041305 Sep 24 14:37:01.169927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 472/941] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:37:01 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:37:01.365491 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:01.366338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:01.368361 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:01.373851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:01.374855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:01.375531 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:01.376455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:01.377136 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:01.377620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:01.564081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:01.567116 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:01.581680 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:01.583170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:01.584865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0b7da896-3d6c-4ca3-a163-6e9a3f1d2c47 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.224184 Sep 24 14:37:01.586159 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 470/942] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:01 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:01.757727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:01.758370 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:01.765498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:01.765989 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:01.766430 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:01.767160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:01.767619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:01.768168 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:01.913838 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:01.922179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-065bc3e6-e128-465e-a862-3c6453df9ab9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.168431 Sep 24 14:37:01.922750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 473/943] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:01 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:02.611865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:02.612475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:02.620329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:02.620811 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:02.621736 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:02.622594 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:02.623070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:02.623489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:02.636500 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b8b0b5f-6252-4259-95cc-d6a340852ace"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:02.639896 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:02.646181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:02.646761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:02.647402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:02.648174 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:02.648859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:02.649358 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:02.739937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:02.789445 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:02.797848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:02.799346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:02.800501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-516f90b8-080e-4c99-97b5-f64af0aab6e6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.192475 Sep 24 14:37:02.801051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 471/944] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:02 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:02.944501 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:02.945211 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:02.955443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:02.955962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:02.956398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:02.957160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:02.957640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:02.958057 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:03.096242 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:03.116470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1226d47a-fdd1-4466-99e0-eaef07a7ab7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.175629 Sep 24 14:37:03.118617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 472/945] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:02 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:03.827115 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:03.827802 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:03.834156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:03.834625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:03.835081 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:03.835775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:03.836397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:03.836627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:03.971386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:03.980831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:03.982306 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:03.983496 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8d1b8bd7-1855-4a88-bff9-b96295e8d20f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.161036 Sep 24 14:37:03.984045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 473/946] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:03 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:04.141639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:04.142247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:04.148221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:04.148707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:04.154661 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:04.155611 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:04.156187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:04.156740 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:04.293962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:04.301984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-792b0f43-1eae-419d-ade4-f236a736391f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.164877 Sep 24 14:37:04.302741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 474/947] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:04 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:05.011715 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:05.013014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:05.019267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:05.019828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:05.020620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:05.021378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:05.021855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:05.022273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:05.159333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:05.168653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:05.172194 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:05.173407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cf5982fb-283d-4912-8197-c58f9ff122d1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.166168 Sep 24 14:37:05.173960 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 475/948] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:05 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:05.325481 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:05.326087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:05.332014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:05.332495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:05.332930 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:05.333613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:05.334065 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:05.334487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:05.468131 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:05.476010 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-89cfd893-4137-408f-9eed-5158f1f1fc42 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.154383 Sep 24 14:37:05.476776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 476/949] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:05 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:06.200053 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:06.200741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:06.207720 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:06.208214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:06.208729 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:06.209507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:06.209970 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:06.210426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:06.350870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:06.359021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:06.360468 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:06.361625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-32a3df1c-c1f9-4b80-8e0e-eeaa7ea748a2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.166019 Sep 24 14:37:06.362180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 477/950] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:06 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:06.502178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:06.502708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:06.508663 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:06.509142 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:06.509575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:06.510254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:06.510710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:06.511155 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:06.648454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:06.656418 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-89d6a6a7-7aad-4727-881d-35e21ea2d041 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.158219 Sep 24 14:37:06.657063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 478/951] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:06 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:07.387455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:07.388863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:07.396326 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:07.396861 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:07.397244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:07.397935 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:07.398413 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:07.398867 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:07.551890 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:07.559944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:07.561416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:07.562637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-33f0d5f6-f328-411b-bf98-029492de79d6 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.179925 Sep 24 14:37:07.563221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 479/952] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:07 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:07.680540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:07.681164 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:07.687552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:07.688189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:07.688632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:07.689360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:07.689808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:07.690322 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:07.837564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:07.845781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-53e7f4c7-fdb6-4503-aaa6-6f5202b520d9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.169581 Sep 24 14:37:07.846732 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 480/953] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:07 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:08.588828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:08.589790 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:08.596520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:08.596935 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:08.597367 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:08.598065 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:08.598512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:08.598960 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:08.736338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:08.744613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:08.746131 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:08.747373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cf797937-bca5-476a-be46-b4b935f377e1 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.162461 Sep 24 14:37:08.747958 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 481/954] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:08 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:08.869644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:08.870249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:08.876413 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:08.879601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:08.880058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:08.880796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:08.881418 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:08.881852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:09.027072 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:09.035984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-eee8e2b1-e4be-4bba-ba7a-ccf77856f839 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.170272 Sep 24 14:37:09.036743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 482/955] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:08 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:09.773684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:09.774337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:09.780944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:09.781420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:09.781849 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:09.782522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:09.783008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:09.783425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:09.910806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:09.919309 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:09.920741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:09.922169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c377de37-d5b6-4314-a6fc-c6277ab10002 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.152467 Sep 24 14:37:09.922724 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 483/956] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:09 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:10.057636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:10.058263 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:10.064534 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:10.065014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:10.065440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:10.066114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:10.066555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:10.067003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:10.196708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:10.204890 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5116900c-c42a-4764-af89-d7177b046832 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.150984 Sep 24 14:37:10.205455 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 484/957] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:10 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:10.948042 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:10.948652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:10.955006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:10.955487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:10.955913 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:10.956589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:10.957067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:10.957488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:11.082971 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:11.091507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:11.092890 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:11.094041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8db78f81-6847-4772-81c2-913b43d1b882 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.149920 Sep 24 14:37:11.094586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 485/958] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:10 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:11.229278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:11.229877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:11.235671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:11.236151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:11.236585 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:11.237263 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:11.237722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:11.238146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:11.366967 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:11.374588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5bd0c402-ae78-4d5a-926c-035d6a3da6ec tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.149229 Sep 24 14:37:11.375180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 486/959] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:11 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:12.119802 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:12.120434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:12.127823 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:12.128305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:12.128736 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:12.129417 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:12.129861 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:12.130278 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:12.145189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:12.255532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:12.263448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:12.264897 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:12.266045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-087f1160-69c6-49d4-8974-25c8ada9b585 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.150261 Sep 24 14:37:12.266599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 487/960] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:12 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:12.398215 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:12.398841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:12.405427 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:12.405907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:12.406340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:12.407055 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:12.407502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:12.407921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:12.534794 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:12.542329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cf501f4f-20c9-40ce-9743-7e6ea642f9f3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.147800 Sep 24 14:37:12.542916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 488/961] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:12 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:12.646661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:12.755273 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:13.290777 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:13.291396 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:13.297749 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:13.298234 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:13.298675 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:13.299363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:13.299838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:13.300252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:13.438026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:13.446273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:13.447751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:13.448932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4440fbac-65eb-4a66-8d82-7799f8bbb691 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.162120 Sep 24 14:37:13.449565 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 489/962] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:13 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:13.565448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:13.565965 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:13.571779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:13.572250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:13.572673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:13.573340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:13.573783 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:13.574195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:13.700558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:13.708162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-448a2160-0875-4c64-9fef-9d17f5e9bd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.146702 Sep 24 14:37:13.708726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 490/963] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:13 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:14.475356 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:14.475961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:14.482382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:14.482883 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:14.483316 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:14.483985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:14.484429 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:14.484845 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:14.623161 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:14.631101 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:14.632557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:14.633692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d9a673b0-50bf-4309-bfbf-64034e1d42cf tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.162294 Sep 24 14:37:14.634244 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 491/964] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:14 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:14.729821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:14.730453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:14.736185 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:14.736663 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:14.737088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:14.737759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:14.738202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:14.738617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:14.866342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:14.876210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6732ca22-749e-40b0-8d0d-c214be7adb29 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.149930 Sep 24 14:37:14.876716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 492/965] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:14 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:15.659622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:15.660331 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:15.666787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:15.667313 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:15.667745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:15.668423 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:15.668876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:15.669296 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:15.797909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:15.805923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:15.807400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:15.808563 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-640c07b0-4f05-4156-a07d-eb14de5c6d66 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.152868 Sep 24 14:37:15.809119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 493/966] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:15 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:37:15.898689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:15.899335 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:15.906118 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:15.906601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:15.907067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:15.907747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:15.908202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:15.908622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:16.277903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:16.285762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2ee2ac1c-71d0-40d3-87d2-7a92af7d118e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.390958 Sep 24 14:37:16.286327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 494/967] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:15 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:37:16.663348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-63a1e9a0-0849-4cd0-b008-ad79b44cf44d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.031409 Sep 24 14:37:16.663945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 474/968] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:37:02 2022] POST /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments => generated 194 bytes in 14033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:37:16.833514 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:16.834349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:16.841293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:16.841656 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:16.842097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:16.842789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:16.843275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:16.843697 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:16.975119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:16.983745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:16.985197 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:16.986364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9811bbf3-1cc9-492a-993c-54d05dca1a04 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.156893 Sep 24 14:37:16.986943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 495/969] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:16 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:17.308555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:17.309250 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:17.315877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:17.316365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:17.316804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:17.317498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:17.317953 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:17.318378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:17.450449 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:17.457955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b1078727-ba85-42e6-aef5-0af1cca8917e tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.153831 Sep 24 14:37:17.458505 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 475/970] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:17 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:18.010934 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:18.011472 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:18.017941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:18.018418 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:18.018868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:18.019542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:18.019988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:18.020407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:18.151343 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:18.159733 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:18.161191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:18.162362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-55555b8a-d5ac-460f-8861-6260bdbc8e8d tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.155459 Sep 24 14:37:18.162949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 496/971] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:18 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:18.481675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:18.482324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:18.488965 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:18.489461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:18.490022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:18.490747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:18.491242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:18.491665 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:18.611089 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-6e9e11f2-2bef-4f46-8f78-a54209c92922 req-4faf4bfb-e2b0-465b-a683-70f21f1e0524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195e775-0693-43e1-98c5-6da051739679", "name": "network-vif-plugged", "status": "completed", "tag": "9bcbf202-4cbf-42d4-9889-2c337cd6d929"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:18.620601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6e9e11f2-2bef-4f46-8f78-a54209c92922 req-4faf4bfb-e2b0-465b-a683-70f21f1e0524 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:18.621084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6e9e11f2-2bef-4f46-8f78-a54209c92922 req-4faf4bfb-e2b0-465b-a683-70f21f1e0524 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:18.621549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6e9e11f2-2bef-4f46-8f78-a54209c92922 req-4faf4bfb-e2b0-465b-a683-70f21f1e0524 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:18.634190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-6e9e11f2-2bef-4f46-8f78-a54209c92922 req-4faf4bfb-e2b0-465b-a683-70f21f1e0524 service nova] Creating event network-vif-plugged:9bcbf202-4cbf-42d4-9889-2c337cd6d929 for instance 3195e775-0693-43e1-98c5-6da051739679 on hv-cinder-85919 Sep 24 14:37:18.640751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-6e9e11f2-2bef-4f46-8f78-a54209c92922 req-4faf4bfb-e2b0-465b-a683-70f21f1e0524 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098488 Sep 24 14:37:18.641366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 497/972] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:37:18.643524 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:18.651452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-87ff27e2-d0dc-4b0a-984c-81cbac3508f2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.174400 Sep 24 14:37:18.652028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 476/973] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:18 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:19.189221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:19.189961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:19.196384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:19.196625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:19.197063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:19.197756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:19.198288 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:19.198633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:19.327309 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:19.335386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:19.336826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:19.337976 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1ff96de9-0108-49a7-9231-67a6c4666012 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.153542 Sep 24 14:37:19.338527 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 498/974] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:19 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:19.673479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:19.674136 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:19.680489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:19.680967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:19.681394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:19.682091 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:19.682534 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:19.682980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:19.811826 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:19.819560 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cbafbf65-d572-4c2f-8035-fdf0c5f0eb90 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.149922 Sep 24 14:37:19.820125 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 477/975] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:19 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:20.365614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:20.366217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:20.373444 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:20.373940 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:20.374375 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:20.375092 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:20.375539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:20.377049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:20.506582 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:20.514996 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:20.516443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:20.517639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fad80bb6-8bef-4c91-9881-e3c61937644f tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.156050 Sep 24 14:37:20.518194 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 499/976] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:20 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:20.657891 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-47d8bcfc-5ddd-4e02-b176-c494ecbecadc req-fbd89bee-f3bb-4fea-90fc-fccb40281feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706136cf-b0bb-4a89-951d-a22ef9428b0b", "name": "network-vif-plugged", "status": "completed", "tag": "bd613a7c-65b3-44db-ac85-45e7485d8eab"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:20.667321 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-47d8bcfc-5ddd-4e02-b176-c494ecbecadc req-fbd89bee-f3bb-4fea-90fc-fccb40281feb service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:20.667785 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-47d8bcfc-5ddd-4e02-b176-c494ecbecadc req-fbd89bee-f3bb-4fea-90fc-fccb40281feb service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:20.668205 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-47d8bcfc-5ddd-4e02-b176-c494ecbecadc req-fbd89bee-f3bb-4fea-90fc-fccb40281feb service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:20.680658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-47d8bcfc-5ddd-4e02-b176-c494ecbecadc req-fbd89bee-f3bb-4fea-90fc-fccb40281feb service nova] Creating event network-vif-plugged:bd613a7c-65b3-44db-ac85-45e7485d8eab for instance 706136cf-b0bb-4a89-951d-a22ef9428b0b on hv-cinder-85919 Sep 24 14:37:20.685722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-47d8bcfc-5ddd-4e02-b176-c494ecbecadc req-fbd89bee-f3bb-4fea-90fc-fccb40281feb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032699 Sep 24 14:37:20.686357 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 478/977] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:37:20.843714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:20.844350 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:20.851140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:20.851615 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:20.852043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:20.852726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:20.853377 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:20.853796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:21.034421 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:21.042352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-48a7f82a-14a5-4652-9c20-f3d1f2cdce3f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.203566 Sep 24 14:37:21.043067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 500/978] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:20 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:21.544019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:21.544703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:21.551304 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:21.551780 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:21.552208 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:21.552879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:21.553326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:21.553744 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:21.680514 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:21.689517 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:21.691156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:21.693116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4762e6b3-3628-479b-94d8-a8beb9199e24 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1728 microversion: 2.20 time: 0.153293 Sep 24 14:37:21.694018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 479/979] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:21 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:22.064869 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:22.065513 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:22.071932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:22.072416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:22.072851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:22.073533 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:22.073984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:22.074407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:22.209341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:22.219153 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8c7a6fa0-78e6-4aa7-b6c0-808a5b4bc11f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1266 microversion: 2.1 time: 0.158057 Sep 24 14:37:22.220058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 501/980] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:22 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:22.718545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:22.719163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:22.725688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:22.726529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:22.727008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:22.727713 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:22.728207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:22.728725 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:22.854781 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:22.866285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:22.868669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:22.870738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-df0d1d1f-3a16-44fe-84f4-d2293b1e9cd2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1715 microversion: 2.20 time: 0.156297 Sep 24 14:37:22.871755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 480/981] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:37:22 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:37:23.245543 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:23.246148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:23.252460 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:23.252936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:23.253364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:23.254037 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:23.254489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:23.254927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:23.386924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:23.395135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-64646279-71e2-43bc-a086-a098d2c428ef tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1453 microversion: 2.1 time: 0.153521 Sep 24 14:37:23.395694 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 502/982] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:23 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:23.417820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:23.418434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:23.424353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:23.424837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:23.425276 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:23.425959 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:23.426414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:23.426860 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:23.555794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:23.563963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-df8430e0-0eff-4d3a-9211-dfe1b93baec9 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1453 microversion: 2.1 time: 0.149942 Sep 24 14:37:23.564526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 481/983] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:23 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:25.203487 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-89ca2b67-9397-4246-9153-1d44d5d7c140 req-92e7e10e-0e66-43c4-ad51-3b046bbef50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706136cf-b0bb-4a89-951d-a22ef9428b0b", "tag": "bd613a7c-65b3-44db-ac85-45e7485d8eab"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:25.213320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-89ca2b67-9397-4246-9153-1d44d5d7c140 req-92e7e10e-0e66-43c4-ad51-3b046bbef50c service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:25.213798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-89ca2b67-9397-4246-9153-1d44d5d7c140 req-92e7e10e-0e66-43c4-ad51-3b046bbef50c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:25.214228 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-89ca2b67-9397-4246-9153-1d44d5d7c140 req-92e7e10e-0e66-43c4-ad51-3b046bbef50c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:25.228387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-89ca2b67-9397-4246-9153-1d44d5d7c140 req-92e7e10e-0e66-43c4-ad51-3b046bbef50c service nova] Creating event network-changed:bd613a7c-65b3-44db-ac85-45e7485d8eab for instance 706136cf-b0bb-4a89-951d-a22ef9428b0b on hv-cinder-85919 Sep 24 14:37:25.234197 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-89ca2b67-9397-4246-9153-1d44d5d7c140 req-92e7e10e-0e66-43c4-ad51-3b046bbef50c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034362 Sep 24 14:37:25.235276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 503/984] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:37:25.297011 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e4e4be84-c62f-40fd-8650-7b6c0f067b21 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: .version_select at 0x7f222a9cdee0>, body: {"keypair": {"name": "tempest-keypair-646242900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbe5dpagPEZawrIsz4tPKW1CTi4JQ6AjyL5lvmTu5r3vlG3ZMQwUe89FEVAKMegoAq65gBFCvI1MbLyAuuFVE7xwTuwOXbqlgA5zVAk2BiC3nIEooqFvIN1HcoONq7EXA=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:25.317727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-e4e4be84-c62f-40fd-8650-7b6c0f067b21 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:37:25.321925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-e4e4be84-c62f-40fd-8650-7b6c0f067b21 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:37:25.347704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e4e4be84-c62f-40fd-8650-7b6c0f067b21 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055483 Sep 24 14:37:25.348312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 482/985] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:37:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:37:26.690168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-713766030", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd29c2a7-29a9-46cb-ada7-34fd38591f69"}], "security_groups": [{"name": "tempest-securitygroup--1623024787"}], "key_name": "tempest-keypair-646242900", "user_data": "}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:26.790448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] validate_networks() for [('dd29c2a7-29a9-46cb-ada7-34fd38591f69', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:37:27.156919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:37:27.157360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:37:27.157830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:37:27.158231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:37:27.158635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:37:27.167241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:27.167719 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:27.168146 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:27.168870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:27.169319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:27.169741 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:27.186060 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:37:27.189986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:37:27.200747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:37:27.203615 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:37:27.251329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cf0e182a-b422-46ee-b3f3-8a622199c3c0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566148 Sep 24 14:37:27.251966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 504/986] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:37:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:37:27.264223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-48ca3c44-457e-4f07-8770-d55916da1668 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:27.264937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-48ca3c44-457e-4f07-8770-d55916da1668 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:27.319161 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-48ca3c44-457e-4f07-8770-d55916da1668 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:27.325788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-48ca3c44-457e-4f07-8770-d55916da1668 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1240 microversion: 2.1 time: 0.066622 Sep 24 14:37:27.327054 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 483/987] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:27 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:28.349719 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:28.350323 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:28.356629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:28.357730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:28.358043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:28.358767 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:28.359222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:28.359638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:28.432902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:28.441267 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3c154ffa-5c22-4f16-b49b-6b8b3f24bb27 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1292 microversion: 2.1 time: 0.096019 Sep 24 14:37:28.441831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 505/988] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:28 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:29.467641 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:29.468263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:29.475615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:29.476205 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:29.476715 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:29.477527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:29.478539 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:29.478783 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:29.877591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:29.885312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-66923838-0f2b-4916-9671-d7c0de8c4220 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.422283 Sep 24 14:37:29.885812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 484/989] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:29 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:30.236789 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-d291fb4b-205e-495c-a081-9f24fbfff25f req-f5a6616b-e4d9-4174-964b-a897eac548da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7469bc81-1670-47f3-95c4-d1092e46a9fb", "tag": "93bff716-3fa0-422f-8621-292de0ae643c"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:30.244651 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:30.249246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d291fb4b-205e-495c-a081-9f24fbfff25f req-f5a6616b-e4d9-4174-964b-a897eac548da service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:30.249812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d291fb4b-205e-495c-a081-9f24fbfff25f req-f5a6616b-e4d9-4174-964b-a897eac548da service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:30.250352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-d291fb4b-205e-495c-a081-9f24fbfff25f req-f5a6616b-e4d9-4174-964b-a897eac548da service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:30.254580 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=100 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:30.264795 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-d291fb4b-205e-495c-a081-9f24fbfff25f req-f5a6616b-e4d9-4174-964b-a897eac548da service nova] Creating event network-changed:93bff716-3fa0-422f-8621-292de0ae643c for instance 7469bc81-1670-47f3-95c4-d1092e46a9fb on hv-cinder-85919 Sep 24 14:37:30.270168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-d291fb4b-205e-495c-a081-9f24fbfff25f req-f5a6616b-e4d9-4174-964b-a897eac548da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037954 Sep 24 14:37:30.270761 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 506/990] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:37:30.908576 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:30.909210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:30.915554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:30.916027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:30.916452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:30.917122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:30.917569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:30.917986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:31.048775 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:31.056267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7481d0a5-73fd-4a68-a397-61530cf08af6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.151892 Sep 24 14:37:31.056851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 485/991] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:30 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:32.080051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:32.080738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:32.087446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:32.087866 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:32.088302 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:32.088972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:32.089418 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:32.089850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:32.219880 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:32.227342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8a341c22-5b8e-41cb-a41a-4c7c3fcb8568 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.152321 Sep 24 14:37:32.227907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 507/992] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:32 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:33.249869 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:33.250483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:33.256930 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:33.257425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:33.257862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:33.258554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:33.259038 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:33.259460 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:33.390222 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:33.397902 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-61b60a0d-68ef-42c5-8107-4c78a763a555 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.151868 Sep 24 14:37:33.398472 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 486/993] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:33 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:34.422437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:34.423063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:34.428858 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:34.429341 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:34.429772 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:34.430451 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:34.430920 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:34.431340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:34.564192 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:34.571956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7f3f6523-79cf-4033-ac8b-220aac5300d6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.154062 Sep 24 14:37:34.572520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 508/994] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:34 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:35.594803 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:35.595431 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:35.601753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:35.602230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:35.602661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:35.603376 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:35.603820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:35.604236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:35.736381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:35.743960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4abc2322-cff6-43d3-b289-b9574aeeb1e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.153047 Sep 24 14:37:35.744520 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 487/995] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:35 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:36.514597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-fa4a048b-7180-47b9-ab70-4553ffec7de2 req-c95697b7-1489-4ad3-a8f1-d9b8e484f057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7469bc81-1670-47f3-95c4-d1092e46a9fb", "name": "network-vif-plugged", "status": "completed", "tag": "93bff716-3fa0-422f-8621-292de0ae643c"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:36.524696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fa4a048b-7180-47b9-ab70-4553ffec7de2 req-c95697b7-1489-4ad3-a8f1-d9b8e484f057 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:36.525184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fa4a048b-7180-47b9-ab70-4553ffec7de2 req-c95697b7-1489-4ad3-a8f1-d9b8e484f057 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:36.525615 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fa4a048b-7180-47b9-ab70-4553ffec7de2 req-c95697b7-1489-4ad3-a8f1-d9b8e484f057 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:36.537180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-fa4a048b-7180-47b9-ab70-4553ffec7de2 req-c95697b7-1489-4ad3-a8f1-d9b8e484f057 service nova] Creating event network-vif-plugged:93bff716-3fa0-422f-8621-292de0ae643c for instance 7469bc81-1670-47f3-95c4-d1092e46a9fb on hv-cinder-85919 Sep 24 14:37:36.542118 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-fa4a048b-7180-47b9-ab70-4553ffec7de2 req-c95697b7-1489-4ad3-a8f1-d9b8e484f057 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031923 Sep 24 14:37:36.542927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 509/996] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:37:36.767284 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:36.768009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:36.774365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:36.774881 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:36.775312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:36.775999 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:36.776448 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:36.776929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:36.906527 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:36.914104 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e80c8bc9-944e-4f5c-87c4-4324c0212a80 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.150746 Sep 24 14:37:36.914660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 488/997] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:36 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:37.934914 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:37.935696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:37.940555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:37.941251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:37.948166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:37.948647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:37.949076 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:37.949755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:37.950209 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:37.950632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:38.090357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:38.098452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2109d995-2453-433b-b077-4788556f9645 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1366 microversion: 2.1 time: 0.164511 Sep 24 14:37:38.099042 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 510/998] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:37 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:39.121289 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:39.121892 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:39.123904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:39.129695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:39.130168 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:39.130591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:39.131294 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:39.131737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:39.132151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:39.261021 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:37:39.269233 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cf0d952f-6823-4cc9-90f6-acf3d4bfae02 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1557 microversion: 2.1 time: 0.151841 Sep 24 14:37:39.269790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 489/999] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:37:39 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:37:39.292339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:37:39.292851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:37:39.299234 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:39.299708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:39.300134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:39.300813 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:39.301259 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:39.301685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:39.379981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-775de626-637e-4e5a-94ca-a8e160294305 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091516 Sep 24 14:37:39.380572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 511/1000] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:37:39 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:37:40.281308 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-0b14439d-01ca-41b2-8b22-28bcf15ce86d req-88eebac2-e72d-4e6f-ae54-8f6cefe6f38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7469bc81-1670-47f3-95c4-d1092e46a9fb", "tag": "93bff716-3fa0-422f-8621-292de0ae643c"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:37:40.291807 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0b14439d-01ca-41b2-8b22-28bcf15ce86d req-88eebac2-e72d-4e6f-ae54-8f6cefe6f38b service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:37:40.292278 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0b14439d-01ca-41b2-8b22-28bcf15ce86d req-88eebac2-e72d-4e6f-ae54-8f6cefe6f38b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:37:40.292831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0b14439d-01ca-41b2-8b22-28bcf15ce86d req-88eebac2-e72d-4e6f-ae54-8f6cefe6f38b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:37:40.304438 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-0b14439d-01ca-41b2-8b22-28bcf15ce86d req-88eebac2-e72d-4e6f-ae54-8f6cefe6f38b service nova] Creating event network-changed:93bff716-3fa0-422f-8621-292de0ae643c for instance 7469bc81-1670-47f3-95c4-d1092e46a9fb on hv-cinder-85919 Sep 24 14:37:40.309374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-0b14439d-01ca-41b2-8b22-28bcf15ce86d req-88eebac2-e72d-4e6f-ae54-8f6cefe6f38b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033319 Sep 24 14:37:40.309961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 490/1001] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:38:27.430464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=11 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:27.433885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:27.434552 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=25 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:27.435260 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:27.437318 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 24 14:38:27.442081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-7eeea134-7f5b-473b-9701-721f9f0ea468 req-35256a46-baad-44f0-a6e1-80e832e3d833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5ccce1-e66b-43e2-8c6e-60858051435f", "tag": "22fef065-180c-4fb8-a36d-5b7d245d2726"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:38:27.445074 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:27.445570 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:27.452892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:27.453424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:27.454147 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:27.454801 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:27.455087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7eeea134-7f5b-473b-9701-721f9f0ea468 req-35256a46-baad-44f0-a6e1-80e832e3d833 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:27.455434 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:27.455567 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7eeea134-7f5b-473b-9701-721f9f0ea468 req-35256a46-baad-44f0-a6e1-80e832e3d833 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:27.455884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:27.456012 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7eeea134-7f5b-473b-9701-721f9f0ea468 req-35256a46-baad-44f0-a6e1-80e832e3d833 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:27.469844 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-7eeea134-7f5b-473b-9701-721f9f0ea468 req-35256a46-baad-44f0-a6e1-80e832e3d833 service nova] Creating event network-changed:22fef065-180c-4fb8-a36d-5b7d245d2726 for instance 7f5ccce1-e66b-43e2-8c6e-60858051435f on hv-cinder-85919 Sep 24 14:38:27.475022 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-7eeea134-7f5b-473b-9701-721f9f0ea468 req-35256a46-baad-44f0-a6e1-80e832e3d833 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042640 Sep 24 14:38:27.475643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 491/1002] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:38:27.486197 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Going to try to terminate instance {{(pid=120744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:38:27.563709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-65c0bac8-cf84-4164-b6d6-ed8d09221bc1 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 204 len: 0 microversion: 2.1 time: 0.134201 Sep 24 14:38:27.566713 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 512/1003] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:38:27 2022] DELETE /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:38:27.573677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:27.574324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:27.581027 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:27.581990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:27.582427 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:27.583313 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:27.583599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:27.584018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:27.718645 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:27.726647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b65698e2-0b23-417e-a365-27704f3840f2 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.157175 Sep 24 14:38:27.727274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 492/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:27 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:28.753571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:28.754197 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:28.760541 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:28.761021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:28.761452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:28.762131 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:28.762581 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:28.763039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:28.963298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:28.971000 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f47ba55b-7b23-4576-8058-54670dc11ce9 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1569 microversion: 2.1 time: 0.222276 Sep 24 14:38:28.971564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 513/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:28 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:29.993564 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:29.994199 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:30.004929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.005746 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.006190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.007089 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.008498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.008498 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.142622 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:30.150950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4341872b-d1f4-47c7-86ab-e3412267bd9b tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1450 microversion: 2.1 time: 0.161180 Sep 24 14:38:30.151800 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 493/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:29 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:30.210907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:30.213383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:30.220633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.221122 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.221557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.222256 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.222983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.223172 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.252888 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6b076f41-c0b2-4f05-8a70-3ee886e466fc tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045819 Sep 24 14:38:30.253316 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 514/1007] 10.222.0.52 () {60 vars in 1343 bytes} [Sat Sep 24 14:38:30 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:30.305859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-8853c303-58c3-499f-b0aa-df81dc0c4193 req-a5b13391-6934-435c-8acc-d14f162aecf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5ccce1-e66b-43e2-8c6e-60858051435f", "name": "network-vif-deleted", "tag": "22fef065-180c-4fb8-a36d-5b7d245d2726"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:38:30.315911 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8853c303-58c3-499f-b0aa-df81dc0c4193 req-a5b13391-6934-435c-8acc-d14f162aecf7 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.316385 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8853c303-58c3-499f-b0aa-df81dc0c4193 req-a5b13391-6934-435c-8acc-d14f162aecf7 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.316809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8853c303-58c3-499f-b0aa-df81dc0c4193 req-a5b13391-6934-435c-8acc-d14f162aecf7 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.323376 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:30.324172 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:30.328699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-8853c303-58c3-499f-b0aa-df81dc0c4193 req-a5b13391-6934-435c-8acc-d14f162aecf7 service nova] Creating event network-vif-deleted:22fef065-180c-4fb8-a36d-5b7d245d2726 for instance 7f5ccce1-e66b-43e2-8c6e-60858051435f on hv-cinder-85919 Sep 24 14:38:30.331269 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.332003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.332438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.333400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.333647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-8853c303-58c3-499f-b0aa-df81dc0c4193 req-a5b13391-6934-435c-8acc-d14f162aecf7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Sep 24 14:38:30.334242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 494/1008] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:38:30.334407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.334929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.361522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Going to try to terminate instance {{(pid=120744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:38:30.443218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e0533f2c-8e8b-42d4-88d7-26fc8f26d076 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 204 len: 0 microversion: 2.20 time: 0.123543 Sep 24 14:38:30.443925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 515/1009] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 14:38:30 2022] DELETE /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 14:38:30.453177 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:30.454019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:30.460019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.460495 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.460968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.461593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:30.462038 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:30.462455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:30.589721 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:30.598951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:30.600426 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:30.601599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-30159d55-2dbe-4c96-b27f-518bb90386c2 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.152787 Sep 24 14:38:30.602159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 495/1010] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:38:30 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:38:31.174466 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:31.175305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:31.181362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:31.181844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:31.182276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:31.182993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:31.183448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:31.183869 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:31.246346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:31.254597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-805925d4-d964-417c-beee-766818c69f58 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1220 microversion: 2.1 time: 0.084537 Sep 24 14:38:31.255187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 516/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:31 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:31.626687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:31.627264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:31.633698 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:31.634175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:31.634607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:31.635316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:31.635766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:31.636185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:31.775316 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:31.783931 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:31.785377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:31.786535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-416a2ad7-d7d1-47fe-aee1-6fa82de68a68 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.163882 Sep 24 14:38:31.787112 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 496/1012] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:38:31 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:38:32.280134 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:32.280988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:32.290703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:32.291509 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:32.292203 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:32.293260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:32.293964 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:32.294616 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:32.327813 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:32.328287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:32.328726 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:32.329201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lazy-loading 'fault' on Instance uuid 7f5ccce1-e66b-43e2-8c6e-60858051435f {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:38:32.371891 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c9bfcd6d1a401194a7176f8aa2e6ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71699c60daeb48aaaf5b0611c8f68bc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:32.380217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0a3d3aa3-3a2a-49e4-a4ab-47a6010d6adc tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 200 len: 1225 microversion: 2.1 time: 0.106372 Sep 24 14:38:32.380776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 517/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:32 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:32.812777 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:32.813385 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:32.820159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:32.820883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:32.821523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:32.822439 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:32.823078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:32.823903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:32.972880 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:32.981056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:32.982484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:32.984154 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3bcbfbd9-9493-4cc1-9fda-2abe47c532c8 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1721 microversion: 2.20 time: 0.175825 Sep 24 14:38:32.984718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 497/1014] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:38:32 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:38:33.405679 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:33.407014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] [instance: 7f5ccce1-e66b-43e2-8c6e-60858051435f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:33.413620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:33.414340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:33.415060 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:33.416008 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:33.416510 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:33.417070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:33.435751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] HTTP exception thrown: Instance 7f5ccce1-e66b-43e2-8c6e-60858051435f could not be found. Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Request method failure captured: Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f HTTP/1.1 Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxUYfK2usV-vOqtBL3EbZGvLYN2sgM2lnLGLL_IlJgEq1419odtl6izbxn8ZQVjp9YN-IaoriINWILVVeDw3GfgLeYMLjqJqO66lF19lkPz_ltS0o2BRAYnTIEhXzLYh3lv9OzZqKMR2tEUhQtt1wjl9MaxtZIfleV9tY53F9hCWtdg Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 71699c60daeb48aaaf5b0611c8f68bc4 Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-TestShelveInstance-656389109 Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:38:33.437707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71699c60daeb48aaaf5b0611c8f68bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_71699c60daeb48aaaf5b0611c8f68bc4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/71699c60daeb48aaaf5b0611c8f68bc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/71699c60daeb48aaaf5b0611c8f68bc4"}]}] Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-TestShelveInstance-656389109 Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 71699c60daeb48aaaf5b0611c8f68bc4 Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-TestShelveInstance-656389109 Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-TestShelveInstance-656389109-project Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: e4c9bfcd6d1a401194a7176f8aa2e6ac Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-TestShelveInstance-656389109-project Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 7f5ccce1-e66b-43e2-8c6e-60858051435f could not be found. Sep 24 14:38:33.439456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '7f5ccce1-e66b-43e2-8c6e-60858051435f'} Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5ccce1-e66b-43e2-8c6e-60858051435f could not be found. Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:38:33.440432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5ccce1-e66b-43e2-8c6e-60858051435f could not be found. Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5ccce1-e66b-43e2-8c6e-60858051435f could not be found. Sep 24 14:38:33.442077 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:33.443525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Returning 404 to user: Instance 7f5ccce1-e66b-43e2-8c6e-60858051435f could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:38:33.443525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7dfdbe4e-dd8d-4d1b-a27a-409b69ae6bb6 tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f" status: 404 len: 111 microversion: 2.1 time: 0.039042 Sep 24 14:38:33.443525 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 518/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:33 2022] GET /compute/v2.1/servers/7f5ccce1-e66b-43e2-8c6e-60858051435f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:38:33.538105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-b20e6769-083f-4569-acb5-d400989c6e99 req-39541b60-a3d6-427a-9952-afe9776a8d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195e775-0693-43e1-98c5-6da051739679", "name": "network-vif-deleted", "tag": "9bcbf202-4cbf-42d4-9889-2c337cd6d929"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:38:33.548336 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b20e6769-083f-4569-acb5-d400989c6e99 req-39541b60-a3d6-427a-9952-afe9776a8d3e service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:33.548814 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b20e6769-083f-4569-acb5-d400989c6e99 req-39541b60-a3d6-427a-9952-afe9776a8d3e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:33.549872 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b20e6769-083f-4569-acb5-d400989c6e99 req-39541b60-a3d6-427a-9952-afe9776a8d3e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:33.560710 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-b20e6769-083f-4569-acb5-d400989c6e99 req-39541b60-a3d6-427a-9952-afe9776a8d3e service nova] Creating event network-vif-deleted:9bcbf202-4cbf-42d4-9889-2c337cd6d929 for instance 3195e775-0693-43e1-98c5-6da051739679 on hv-cinder-85919 Sep 24 14:38:33.566185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-b20e6769-083f-4569-acb5-d400989c6e99 req-39541b60-a3d6-427a-9952-afe9776a8d3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Sep 24 14:38:33.568942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 498/1016] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:38:33.624607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-26ac8c8f-2250-4aa3-9890-d0499096c4eb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] Calling method '.version_select at 0x7f222e197ee0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:33.666438 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-26ac8c8f-2250-4aa3-9890-d0499096c4eb tempest-TestShelveInstance-656389109 tempest-TestShelveInstance-656389109-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1733592383" status: 202 len: 0 microversion: 2.1 time: 0.045646 Sep 24 14:38:33.667051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 519/1017] 10.222.0.52 () {58 vars in 1254 bytes} [Sat Sep 24 14:38:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1733592383 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:38:34.012583 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:34.013301 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:34.019929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:34.020664 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:34.021381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:34.022325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:34.022781 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:34.023417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:34.058607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:34.059361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:34.059959 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:34.060568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lazy-loading 'fault' on Instance uuid 3195e775-0693-43e1-98c5-6da051739679 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:38:34.113016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:34.121530 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:34.123106 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '883e6570afb84a099e46cdace5a88b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7134ad65014cb984417c99b3d76eff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:34.124317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e9771f92-05e4-41a3-8cc0-017b46017de0 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 200 len: 1372 microversion: 2.20 time: 0.118394 Sep 24 14:38:34.124878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 499/1018] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:38:34 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:38:35.149989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:35.151249 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:35.158166 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:35.158652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:35.159110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:35.159799 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:35.160250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:35.160675 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:35.174314 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] HTTP exception thrown: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Request method failure captured: Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 HTTP/1.1 Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOOH9gj2RdEW891oSPJTXS3S25NXC1pJYJ9yGYn-9tAQJt7A0MvPzna3lGV-qZQzyxgrRTPm4t69sM9Pupgx94V7WXIQpfnU4Quzo2hkK_82LDEGYCmTFZIPzNSWErsY8EQKmm7Vd_P8DltwIILs3MqHQm6XDbW5l_2bhFvfSn_I2U Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:38:35.175896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1f7134ad65014cb984417c99b3d76eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1f7134ad65014cb984417c99b3d76eff"}]}] Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 883e6570afb84a099e46cdace5a88b2e Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:35.177415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '3195e775-0693-43e1-98c5-6da051739679'} Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:38:35.178231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:35.179986 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:35.182038 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Returning 404 to user: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:38:35.182038 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-63e21f31-e4be-4cc4-842b-338bb4cf1a3e tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 404 len: 111 microversion: 2.20 time: 0.031814 Sep 24 14:38:35.182038 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 520/1019] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:38:35 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:38:35.191945 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2ed4cd70-5a18-418a-b26a-d814c6f2419c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '.version_select at 0x7f222a99c550>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:35.211399 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2ed4cd70-5a18-418a-b26a-d814c6f2419c tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007924367" status: 204 len: 0 microversion: 2.20 time: 0.027867 Sep 24 14:38:35.212479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 500/1020] 10.222.0.52 () {60 vars in 1262 bytes} [Sat Sep 24 14:38:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007924367 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 14:38:37.016788 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:37.017303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:37.023674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:37.024156 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:37.024588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:37.025275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:37.025721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:37.026140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:37.039933 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] HTTP exception thrown: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Request method failure captured: Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 HTTP/1.1 Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOOH9gj2RdEW891oSPJTXS3S25NXC1pJYJ9yGYn-9tAQJt7A0MvPzna3lGV-qZQzyxgrRTPm4t69sM9Pupgx94V7WXIQpfnU4Quzo2hkK_82LDEGYCmTFZIPzNSWErsY8EQKmm7Vd_P8DltwIILs3MqHQm6XDbW5l_2bhFvfSn_I2U Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:38:37.041469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1f7134ad65014cb984417c99b3d76eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1f7134ad65014cb984417c99b3d76eff"}]}] Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 883e6570afb84a099e46cdace5a88b2e Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.042968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '3195e775-0693-43e1-98c5-6da051739679'} Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:38:37.046653 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.047954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.049179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Returning 404 to user: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:38:37.049179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-98829252-22b2-4c84-acc5-6cddc4f52751 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 404 len: 111 microversion: 2.20 time: 0.030649 Sep 24 14:38:37.049179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 521/1021] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 14:38:37 2022] DELETE /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 14:38:37.051717 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:37.052321 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 3195e775-0693-43e1-98c5-6da051739679] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:37.059030 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:37.059513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:37.059939 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:37.060615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:37.061550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:37.061973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:37.074773 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] HTTP exception thrown: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Request method failure captured: Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 HTTP/1.1 Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxOOH9gj2RdEW891oSPJTXS3S25NXC1pJYJ9yGYn-9tAQJt7A0MvPzna3lGV-qZQzyxgrRTPm4t69sM9Pupgx94V7WXIQpfnU4Quzo2hkK_82LDEGYCmTFZIPzNSWErsY8EQKmm7Vd_P8DltwIILs3MqHQm6XDbW5l_2bhFvfSn_I2U Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:38:37.076413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1f7134ad65014cb984417c99b3d76eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1f7134ad65014cb984417c99b3d76eff"}]}] Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: 883e6570afb84a099e46cdace5a88b2e Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.078614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '3195e775-0693-43e1-98c5-6da051739679'} Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:38:37.079496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. Sep 24 14:38:37.080843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:37.082004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Returning 404 to user: Instance 3195e775-0693-43e1-98c5-6da051739679 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:38:37.082004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-47a78be6-9166-4ea2-bf6d-4970a3ec2027 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679" status: 404 len: 111 microversion: 2.20 time: 0.030961 Sep 24 14:38:37.082004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 501/1022] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:38:37 2022] GET /compute/v2.1/servers/3195e775-0693-43e1-98c5-6da051739679 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 14:38:38.220640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:38.221138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:38.227521 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:38.227999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:38.228430 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:38.229112 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:38.229563 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:38.229982 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:38.243673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] HTTP exception thrown: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Request method failure captured: Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca HTTP/1.1 Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxOOH9gj2RdEW891oSPJTXS3S25NXC1pJYJ9yGYn-9tAQJt7A0MvPzna3lGV-qZQzyxgrRTPm4t69sM9Pupgx94V7WXIQpfnU4Quzo2hkK_82LDEGYCmTFZIPzNSWErsY8EQKmm7Vd_P8DltwIILs3MqHQm6XDbW5l_2bhFvfSn_I2U Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:38:38.245210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1f7134ad65014cb984417c99b3d76eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1f7134ad65014cb984417c99b3d76eff"}]}] Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 883e6570afb84a099e46cdace5a88b2e Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.246922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '153f3eef-0f34-4a4a-8738-274bcb2737ca'} Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:38:38.247748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.249577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.251214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Returning 404 to user: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:38:38.251214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5a4bc89d-718e-4301-ab45-b6f9ee4a6b17 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "DELETE /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 404 len: 111 microversion: 2.20 time: 0.030096 Sep 24 14:38:38.251214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 522/1023] 10.222.0.52 () {60 vars in 1280 bytes} [Sat Sep 24 14:38:38 2022] DELETE /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:38:38.256800 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:38.257405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] [instance: 153f3eef-0f34-4a4a-8738-274bcb2737ca] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:38.263763 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:38.264246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:38.264675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:38.265352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:38.265796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:38.266210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:38.279626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] HTTP exception thrown: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Request method failure captured: Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca HTTP/1.1 Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxOOH9gj2RdEW891oSPJTXS3S25NXC1pJYJ9yGYn-9tAQJt7A0MvPzna3lGV-qZQzyxgrRTPm4t69sM9Pupgx94V7WXIQpfnU4Quzo2hkK_82LDEGYCmTFZIPzNSWErsY8EQKmm7Vd_P8DltwIILs3MqHQm6XDbW5l_2bhFvfSn_I2U Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:38:38.281156 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1f7134ad65014cb984417c99b3d76eff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1f7134ad65014cb984417c99b3d76eff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1f7134ad65014cb984417c99b3d76eff"}]}] Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 1f7134ad65014cb984417c99b3d76eff Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1614680037 Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: 883e6570afb84a099e46cdace5a88b2e Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1614680037-project Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.282879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '153f3eef-0f34-4a4a-8738-274bcb2737ca'} Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:38:38.283658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. Sep 24 14:38:38.284889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:38:38.285993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] Returning 404 to user: Instance 153f3eef-0f34-4a4a-8738-274bcb2737ca could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:38:38.285993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d7d5cfe3-d64c-4d81-bb2c-e86d541eb5c3 tempest-AttachVolumeShelveTestJSON-1614680037 tempest-AttachVolumeShelveTestJSON-1614680037-project] 10.222.0.52 "GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca" status: 404 len: 111 microversion: 2.20 time: 0.029855 Sep 24 14:38:38.285993 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 502/1024] 10.222.0.52 () {60 vars in 1277 bytes} [Sat Sep 24 14:38:38 2022] GET /compute/v2.1/servers/153f3eef-0f34-4a4a-8738-274bcb2737ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:38:47.505141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4dd4a1b3-708d-4822-851f-d9d528cc413f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'create', calling method: .version_select at 0x7f222aaa5af0>, body: {"keypair": {"name": "tempest-keypair-57655990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOM6gWhy2vSEBeVz3OHykowtruog9NVnhxWAopYRwqMVyXvSb+nnSVPOiJBYCeLi3+X98FLdR3XsjVpxvO6hojk25yVSwpxOqDl7SuNpDDpIIWPjeP44aE6dj/FseU0g=="}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:38:47.524369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-4dd4a1b3-708d-4822-851f-d9d528cc413f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:38:47.528337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-4dd4a1b3-708d-4822-851f-d9d528cc413f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for user f5d7b40e78a049cd83d079291c3601ff and project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'key_pairs'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:38:47.552120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4dd4a1b3-708d-4822-851f-d9d528cc413f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.166845 Sep 24 14:38:47.552882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 523/1025] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:38:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:38:49.129738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-121525973", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91a2cf93-1fab-4d21-a55a-3c3eecea066b"}], "security_groups": [{"name": "tempest-securitygroup--1646575162"}], "key_name": "tempest-keypair-57655990", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:38:49.138634 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:49.139538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=48 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:49.235655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] validate_networks() for [('91a2cf93-1fab-4d21-a55a-3c3eecea066b', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:38:49.646718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:38:49.647366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:38:49.647832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:38:49.648746 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:38:49.649341 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:38:49.660535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:49.661330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:49.661943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:49.663079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:49.663525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:49.664121 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:49.682633 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:38:49.687724 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for user f5d7b40e78a049cd83d079291c3601ff and project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:38:49.698792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:38:49.701143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:38:49.748748 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8cb35af4-a059-4e6e-9425-521a069590ba tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622703 Sep 24 14:38:49.749557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 503/1026] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:38:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:38:49.760546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-136c33b0-3d8c-4993-b58f-4a57e8a523b2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:49.761158 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-136c33b0-3d8c-4993-b58f-4a57e8a523b2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:49.763182 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:49.824696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-136c33b0-3d8c-4993-b58f-4a57e8a523b2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:49.836193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-136c33b0-3d8c-4993-b58f-4a57e8a523b2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1235 microversion: 2.1 time: 0.079477 Sep 24 14:38:49.837711 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 524/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:49 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:50.861283 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:50.862623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:50.873688 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:50.875145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:50.875767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:50.877072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:50.878082 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:50.878707 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:50.951097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:50.966681 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c6ba9cae-7f9c-4e76-a11c-f1386a5bbd71 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1287 microversion: 2.1 time: 0.111121 Sep 24 14:38:50.967413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 504/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:50 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:51.989542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:51.990289 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:51.996703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:51.997128 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:51.997660 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:51.998926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:51.999378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:51.999796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:52.216113 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:52.223757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e9a7ebcc-3462-4a01-b48e-1519ca707879 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.238134 Sep 24 14:38:52.224549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 525/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:51 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:52.599565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e496f2b1-32de-4989-ac36-ae657b5e8938 req-a01a6b7d-e43e-4d28-88f1-f085b96d4b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee65d370-8082-417a-bb3d-5816c602da9f", "tag": "1e1b1630-2a20-474d-8181-2d01b2f828a6"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:38:52.614026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e496f2b1-32de-4989-ac36-ae657b5e8938 req-a01a6b7d-e43e-4d28-88f1-f085b96d4b58 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:52.614620 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e496f2b1-32de-4989-ac36-ae657b5e8938 req-a01a6b7d-e43e-4d28-88f1-f085b96d4b58 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:52.615171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e496f2b1-32de-4989-ac36-ae657b5e8938 req-a01a6b7d-e43e-4d28-88f1-f085b96d4b58 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:52.628481 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e496f2b1-32de-4989-ac36-ae657b5e8938 req-a01a6b7d-e43e-4d28-88f1-f085b96d4b58 service nova] Creating event network-changed:1e1b1630-2a20-474d-8181-2d01b2f828a6 for instance ee65d370-8082-417a-bb3d-5816c602da9f on hv-cinder-85919 Sep 24 14:38:52.633529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e496f2b1-32de-4989-ac36-ae657b5e8938 req-a01a6b7d-e43e-4d28-88f1-f085b96d4b58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038958 Sep 24 14:38:52.634124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 505/1030] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:38:53.247221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:53.247753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:53.254408 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:53.254927 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:53.255343 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:53.256025 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:53.256475 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:53.256890 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:53.386765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:53.394744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c8ab41bc-1794-427a-9470-ab6355035d3c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.151722 Sep 24 14:38:53.395329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 526/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:53 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:54.418046 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:54.418736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:54.425904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:54.426387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:54.426832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:54.427513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:54.427979 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:54.428395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:54.556256 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:54.563770 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6f979327-808c-4843-9307-8dacd02003f9 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.150015 Sep 24 14:38:54.564335 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 506/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:54 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:55.588446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:55.589064 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:55.596450 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:55.596943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:55.597386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:55.598084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:55.598547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:55.599016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:55.811825 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:55.823396 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ffee10ad-f9d8-47f7-be23-8a10243ce7d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.239899 Sep 24 14:38:55.824206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 527/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:55 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:38:56.847409 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:56.848648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:56.855203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:56.855684 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:56.856117 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:56.856796 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:56.857242 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:56.857656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:56.985874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:56.993404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2326ea4f-c339-4912-9932-71eed940dd06 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.149939 Sep 24 14:38:56.993951 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 507/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:56 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:58.016046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:58.016614 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:58.018969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:38:58.024059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:58.024541 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:58.024975 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:58.025658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:58.026110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:58.026532 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:58.160938 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:58.168452 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-98a29156-979d-4e4d-9965-9ec69ef172da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.156420 Sep 24 14:38:58.169007 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 528/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:58 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:38:58.893124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-6a207a77-57d9-40e4-be92-1082ed4855ea req-71a517e7-b38e-4926-adf6-0163ee900478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65d370-8082-417a-bb3d-5816c602da9f", "name": "network-vif-plugged", "status": "completed", "tag": "1e1b1630-2a20-474d-8181-2d01b2f828a6"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:38:58.904121 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6a207a77-57d9-40e4-be92-1082ed4855ea req-71a517e7-b38e-4926-adf6-0163ee900478 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:58.904614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6a207a77-57d9-40e4-be92-1082ed4855ea req-71a517e7-b38e-4926-adf6-0163ee900478 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:58.905541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-6a207a77-57d9-40e4-be92-1082ed4855ea req-71a517e7-b38e-4926-adf6-0163ee900478 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:58.918855 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-6a207a77-57d9-40e4-be92-1082ed4855ea req-71a517e7-b38e-4926-adf6-0163ee900478 service nova] Creating event network-vif-plugged:1e1b1630-2a20-474d-8181-2d01b2f828a6 for instance ee65d370-8082-417a-bb3d-5816c602da9f on hv-cinder-85919 Sep 24 14:38:58.924307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-6a207a77-57d9-40e4-be92-1082ed4855ea req-71a517e7-b38e-4926-adf6-0163ee900478 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Sep 24 14:38:58.925196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 508/1036] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:38:59.191867 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:38:59.192507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:38:59.198678 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:59.199187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:59.199618 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:59.200292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:38:59.200746 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:38:59.201165 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:38:59.327470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:38:59.335014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9597bf13-9228-453d-81ba-b534b2e96b10 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.147031 Sep 24 14:38:59.335601 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 529/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:38:59 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:00.355517 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:00.356203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:00.361224 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:00.361915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:00.368940 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:00.369420 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:00.369849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:00.370526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:00.371019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:00.371438 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:00.501437 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:00.509041 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-750d25a8-c8fa-4e8b-8a48-efef022216d0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1361 microversion: 2.1 time: 0.154593 Sep 24 14:39:00.509596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 509/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:00 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:01.533039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:01.533638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:01.535539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:01.540980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:01.541456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:01.541881 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:01.542554 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:01.543030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:01.543451 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:01.678025 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:01.687171 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3b54c0d2-0f9d-4a29-bb58-48725dde1fb4 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1548 microversion: 2.1 time: 0.158630 Sep 24 14:39:01.688354 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 530/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:01 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:01.710217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:01.710690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:01.717362 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:01.717834 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:01.718262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:01.718963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:01.719410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:01.719827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:01.794470 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-05ae709a-fd5f-4264-bf82-3a694a9cd014 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088151 Sep 24 14:39:01.795103 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 510/1040] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:39:01 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:02.783084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-e8538be1-f418-4546-9ac4-7ffeac97023d req-0209b3e8-09bc-4773-8b6b-3a5218828534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee65d370-8082-417a-bb3d-5816c602da9f", "tag": "1e1b1630-2a20-474d-8181-2d01b2f828a6"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:02.792431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-e8538be1-f418-4546-9ac4-7ffeac97023d req-0209b3e8-09bc-4773-8b6b-3a5218828534 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:02.793144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-e8538be1-f418-4546-9ac4-7ffeac97023d req-0209b3e8-09bc-4773-8b6b-3a5218828534 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:02.793573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-e8538be1-f418-4546-9ac4-7ffeac97023d req-0209b3e8-09bc-4773-8b6b-3a5218828534 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:02.804401 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-e8538be1-f418-4546-9ac4-7ffeac97023d req-0209b3e8-09bc-4773-8b6b-3a5218828534 service nova] Creating event network-changed:1e1b1630-2a20-474d-8181-2d01b2f828a6 for instance ee65d370-8082-417a-bb3d-5816c602da9f on hv-cinder-85919 Sep 24 14:39:02.809433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-e8538be1-f418-4546-9ac4-7ffeac97023d req-0209b3e8-09bc-4773-8b6b-3a5218828534 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088821 Sep 24 14:39:02.810012 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 531/1041] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:09.800652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:09.801147 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:09.807143 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:09.807624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:09.808064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:09.809122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:09.809574 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:09.809992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:09.834034 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e8daa400-fbc5-43df-b43a-66e73194a259 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb/ips" status: 200 len: 151 microversion: 2.1 time: 0.037900 Sep 24 14:39:09.834605 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 511/1042] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:39:09 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:09.847305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b8b0b5f-6252-4259-95cc-d6a340852ace"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:09.849752 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:09.855821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:09.856295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:09.856723 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:09.857397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:09.857842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:09.858262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:09.935834 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Invalid volume: volume 5b8b0b5f-6252-4259-95cc-d6a340852ace is already attached to instances: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: POST /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb/os-volume_attachments HTTP/1.1 Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 74 Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:39:09.937545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {"volumeAttachment": {"volumeId": "5b8b0b5f-6252-4259-95cc-d6a340852ace"}} Sep 24 14:39:09.939847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Invalid volume: volume 5b8b0b5f-6252-4259-95cc-d6a340852ace is already attached to instances: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'server_id': '7469bc81-1670-47f3-95c4-d1092e46a9fb', 'body': {'volumeAttachment': {'volumeId': '5b8b0b5f-6252-4259-95cc-d6a340852ace'}}} Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5b8b0b5f-6252-4259-95cc-d6a340852ace is already attached to instances: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:09.940739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5b8b0b5f-6252-4259-95cc-d6a340852ace is already attached to instances: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:09.942193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5b8b0b5f-6252-4259-95cc-d6a340852ace is already attached to instances: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 400 to user: Invalid volume: volume 5b8b0b5f-6252-4259-95cc-d6a340852ace is already attached to instances: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8eb2c0ef-8509-4df2-9e47-19eb489adcec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096649 Sep 24 14:39:09.943828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 532/1043] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:39:09 2022] POST /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:39:09.948334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:09.948766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:09.954614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:09.955112 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:09.955541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:09.956210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:09.956654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:09.957069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:09.980725 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:39:10.056381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5bd5d389-d99f-4dd1-b2ba-7599c3c2671f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 204 len: 0 microversion: 2.1 time: 0.111498 Sep 24 14:39:10.056994 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 512/1044] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:39:09 2022] DELETE /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:39:10.066174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:10.066780 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:10.073457 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:10.073940 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:10.074384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:10.075083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:10.075535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:10.075960 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:10.203390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:10.211199 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2b9201d1-c07d-460e-9af3-e082cd88d05c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1682 microversion: 2.1 time: 0.149503 Sep 24 14:39:10.211803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 533/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:10 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:39:11.237053 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:11.237754 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:11.244219 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:11.244708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:11.245148 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:11.245821 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:11.246268 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:11.246685 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:11.381566 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:11.391664 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1706afd5-91ff-4342-8329-b8fab9d1156e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1682 microversion: 2.1 time: 0.158803 Sep 24 14:39:11.392820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 513/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:11 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:12.415747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:12.417046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:12.424005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:12.424493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:12.424925 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:12.425619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:12.426069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:12.426490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:12.496695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:12.504885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f08c0375-fdc8-40e8-9e50-40d9b7e2de9c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 200 len: 1614 microversion: 2.1 time: 0.093039 Sep 24 14:39:12.505682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 534/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:12 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:12.658889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-c835c8a1-d996-4c9f-bb0c-84b6626a1da5 req-472ab5ed-fc50-4864-80c9-b53e3efd79a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7469bc81-1670-47f3-95c4-d1092e46a9fb", "name": "network-vif-deleted", "tag": "93bff716-3fa0-422f-8621-292de0ae643c"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:12.673599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-c835c8a1-d996-4c9f-bb0c-84b6626a1da5 req-472ab5ed-fc50-4864-80c9-b53e3efd79a8 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:12.674077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-c835c8a1-d996-4c9f-bb0c-84b6626a1da5 req-472ab5ed-fc50-4864-80c9-b53e3efd79a8 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:12.674505 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-c835c8a1-d996-4c9f-bb0c-84b6626a1da5 req-472ab5ed-fc50-4864-80c9-b53e3efd79a8 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:12.690538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-c835c8a1-d996-4c9f-bb0c-84b6626a1da5 req-472ab5ed-fc50-4864-80c9-b53e3efd79a8 service nova] Creating event network-vif-deleted:93bff716-3fa0-422f-8621-292de0ae643c for instance 7469bc81-1670-47f3-95c4-d1092e46a9fb on hv-cinder-85919 Sep 24 14:39:12.697447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-c835c8a1-d996-4c9f-bb0c-84b6626a1da5 req-472ab5ed-fc50-4864-80c9-b53e3efd79a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042508 Sep 24 14:39:12.698651 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 514/1048] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:13.528559 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:13.529168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:13.536537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:13.536959 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:13.537391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:13.538083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:13.538538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:13.538988 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:13.552658 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb HTTP/1.1 Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:39:13.554195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:39:13.555951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '7469bc81-1670-47f3-95c4-d1092e46a9fb'} Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:39:13.556821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:39:13.558205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:39:13.559526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:39:13.559526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ce86f62e-eb19-4a88-a342-40455d71f5cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 404 len: 111 microversion: 2.1 time: 0.030964 Sep 24 14:39:13.559526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 535/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:13 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:39:13.565756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3eac2703-21d6-4a87-869c-1a74fbaf41df tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '.version_select at 0x7f222a998160>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:13.585867 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3eac2703-21d6-4a87-869c-1a74fbaf41df tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646242900" status: 202 len: 0 microversion: 2.1 time: 0.024465 Sep 24 14:39:13.586455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 515/1050] 10.222.0.52 () {58 vars in 1218 bytes} [Sat Sep 24 14:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646242900 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:39:14.496900 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:14.497379 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:14.503816 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:14.504293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:14.504725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:14.505431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:14.505882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:14.506304 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:14.585659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lazy-loading 'services' on Instance uuid c97c9001-9a6b-44d2-bbf3-aca4ea818bbc {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:39:14.655432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3eb3e351-4750-4d84-80f5-2041769862f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments/5b8b0b5f-6252-4259-95cc-d6a340852ace" status: 202 len: 0 microversion: 2.1 time: 0.162191 Sep 24 14:39:14.655993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 536/1051] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:39:14 2022] DELETE /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments/5b8b0b5f-6252-4259-95cc-d6a340852ace => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:39:14.665029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:14.667413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:14.675270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:14.675769 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:14.676196 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:14.677200 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:14.677658 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:14.678084 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:14.712205 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2cd4eaec-715b-4f92-8ef6-308c54b14dda tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051502 Sep 24 14:39:14.712768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 516/1052] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:39:14 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:15.726151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:15.728486 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:15.734627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:15.735141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:15.735574 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:15.736315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:15.736765 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:15.737183 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:15.772086 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-4ab2025e-67f6-4ed7-9981-affe313cb126 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050692 Sep 24 14:39:15.772670 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 537/1053] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:39:15 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:39:15.834672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:15.835218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:15.841535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:15.842015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:15.842447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:15.843189 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:15.843643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:15.844064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:15.870333 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:39:15.945237 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-234e403e-6d17-4232-814f-b6379600862c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 204 len: 0 microversion: 2.1 time: 0.113864 Sep 24 14:39:15.946186 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 517/1054] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:39:15 2022] DELETE /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 14:39:15.954162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:15.954764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:15.960636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:15.961116 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:15.961549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:15.962229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:15.962674 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:15.963141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:16.094284 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:16.103106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-55bb0a3c-bdc2-488d-b523-8d730121c59b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1681 microversion: 2.1 time: 0.152918 Sep 24 14:39:16.103666 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 538/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:15 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:17.127049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:17.127669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:17.133978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:17.134462 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:17.134927 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:17.135609 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:17.136062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:17.136485 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:17.263544 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:17.271185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cf94b8fc-2760-4630-8865-669618f58899 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1681 microversion: 2.1 time: 0.148522 Sep 24 14:39:17.271738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 518/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:17 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:18.295887 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:18.296598 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:18.303119 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:18.303599 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:18.304026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:18.304869 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:18.305342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:18.305772 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:18.519984 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:18.527557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-eef54b7e-bcbc-46b4-a8e1-8ba3d20aaa50 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1681 microversion: 2.1 time: 0.235517 Sep 24 14:39:18.528120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 539/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:18 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:19.094291 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-9187b28a-2599-47cc-9e3b-277033da9b55 req-30e53637-79af-4af5-b64e-400ae2f59642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97c9001-9a6b-44d2-bbf3-aca4ea818bbc", "name": "network-vif-deleted", "tag": "044af794-88a5-48b6-b924-7e393056241b"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:19.106920 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-9187b28a-2599-47cc-9e3b-277033da9b55 req-30e53637-79af-4af5-b64e-400ae2f59642 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:19.107388 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-9187b28a-2599-47cc-9e3b-277033da9b55 req-30e53637-79af-4af5-b64e-400ae2f59642 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:19.107809 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-9187b28a-2599-47cc-9e3b-277033da9b55 req-30e53637-79af-4af5-b64e-400ae2f59642 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:19.121604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-9187b28a-2599-47cc-9e3b-277033da9b55 req-30e53637-79af-4af5-b64e-400ae2f59642 service nova] Creating event network-vif-deleted:044af794-88a5-48b6-b924-7e393056241b for instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc on hv-cinder-85919 Sep 24 14:39:19.128841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-9187b28a-2599-47cc-9e3b-277033da9b55 req-30e53637-79af-4af5-b64e-400ae2f59642 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038544 Sep 24 14:39:19.129432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 519/1058] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:39:19.552058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:19.552657 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:19.558981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:19.559405 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:19.559830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:19.560506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:19.560949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:19.561369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:19.591826 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:19.592363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:19.592716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:19.593148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lazy-loading 'fault' on Instance uuid c97c9001-9a6b-44d2-bbf3-aca4ea818bbc {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:39:19.633846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:19.641488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3d055592-fa3a-417c-868b-6dec957dc8cc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 200 len: 1332 microversion: 2.1 time: 0.093852 Sep 24 14:39:19.642804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 540/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:19 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:20.667581 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:20.668207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:20.670607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:20.676642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:20.677121 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:20.677597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:20.678272 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:20.678722 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:20.679171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:20.684627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:20.696282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc HTTP/1.1 Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:39:20.697943 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:39:20.699607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'c97c9001-9a6b-44d2-bbf3-aca4ea818bbc'} Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:39:20.700461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:39:20.701767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:20.702921 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:39:20.702921 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6209f9f3-07d3-43d1-bfa3-0dfbc3ae0e78 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 404 len: 111 microversion: 2.1 time: 0.036067 Sep 24 14:39:20.702921 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 520/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:20 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:39:20.708181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-75ec98f7-3324-4255-9398-b80447c00511 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '.version_select at 0x7f222ab1cc10>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:20.725597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-75ec98f7-3324-4255-9398-b80447c00511 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258484243" status: 202 len: 0 microversion: 2.1 time: 0.021265 Sep 24 14:39:20.726138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 541/1061] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 14:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258484243 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:39:21.323694 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a73f2f6a-9c02-4049-ab4a-c2448fc63410 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: .version_select at 0x7f222a9658b0>, body: {"keypair": {"name": "tempest-keypair-1765717140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuI1I+R/Jug4zDRm6xGKpCVkDeAIfvQhCXiEqLJxLSYWeD7F3yCTKLx5wu3y1tb4V2DhePqNQFlsVPFwAKYnPGOcTLj73tVsqRiYQUxaRlTvKCtT+HiAYiM7zSrlIS5yw=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:21.342136 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-a73f2f6a-9c02-4049-ab4a-c2448fc63410 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:39:21.346111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-a73f2f6a-9c02-4049-ab4a-c2448fc63410 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:39:21.367267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a73f2f6a-9c02-4049-ab4a-c2448fc63410 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047800 Sep 24 14:39:21.367852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 521/1062] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:39:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:22.629133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310663937", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd29c2a7-29a9-46cb-ada7-34fd38591f69"}], "security_groups": [{"name": "tempest-securitygroup--1703993289"}], "key_name": "tempest-keypair-1765717140", "user_data": "}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:22.756228 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] validate_networks() for [('dd29c2a7-29a9-46cb-ada7-34fd38591f69', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:39:23.375219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:39:23.375639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:39:23.376616 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:39:23.377021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:39:23.377426 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:39:23.385870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:23.386339 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:23.386769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:23.387507 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:23.387952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:23.388648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:23.396290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:23.409261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:39:23.413099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:39:23.424226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:39:23.426467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:39:23.473363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e1e36757-4028-4dcb-835f-0a92e1fb52ec tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.849804 Sep 24 14:39:23.474114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 542/1063] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:39:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:39:23.488473 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f2a594a3-5d4a-46e9-8446-cf86e57ef74f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:23.488473 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f2a594a3-5d4a-46e9-8446-cf86e57ef74f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:23.557157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f2a594a3-5d4a-46e9-8446-cf86e57ef74f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:23.564718 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f2a594a3-5d4a-46e9-8446-cf86e57ef74f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1241 microversion: 2.1 time: 0.083302 Sep 24 14:39:23.565290 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 522/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:23 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:24.587515 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:24.588150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:24.594231 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:24.594721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:24.595184 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:24.596087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:24.597123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:24.597558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:24.659251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:24.667064 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9913857c-438b-4c9e-a2f1-7f269a0812fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1301 microversion: 2.1 time: 0.084077 Sep 24 14:39:24.667667 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 543/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:24 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:25.692107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:25.698342 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:25.705365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:25.706085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:25.706508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:25.707640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:25.708309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:25.708732 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:25.849655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:25.861549 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-146314c8-e5e1-4ac5-ba4b-7aae2fc500e0 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1367 microversion: 2.1 time: 0.174928 Sep 24 14:39:25.862133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 523/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:25 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:39:26.602089 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-78815d24-fc02-4d91-8c40-a1d5d2186f13 req-2271b3f0-9123-418e-a0b6-bac4c3883933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ffbba6-156b-4644-a4ef-28c5dcaffbd4", "tag": "c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:26.614574 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-78815d24-fc02-4d91-8c40-a1d5d2186f13 req-2271b3f0-9123-418e-a0b6-bac4c3883933 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:26.615301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-78815d24-fc02-4d91-8c40-a1d5d2186f13 req-2271b3f0-9123-418e-a0b6-bac4c3883933 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:26.615739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-78815d24-fc02-4d91-8c40-a1d5d2186f13 req-2271b3f0-9123-418e-a0b6-bac4c3883933 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:26.629266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-78815d24-fc02-4d91-8c40-a1d5d2186f13 req-2271b3f0-9123-418e-a0b6-bac4c3883933 service nova] Creating event network-changed:c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321 for instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 on hv-cinder-85919 Sep 24 14:39:26.634190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-78815d24-fc02-4d91-8c40-a1d5d2186f13 req-2271b3f0-9123-418e-a0b6-bac4c3883933 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 Sep 24 14:39:26.634768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 544/1067] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:26.883985 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:26.884586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:26.890936 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:26.891418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:26.891864 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:26.892559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:26.892981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:26.893392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:27.031788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:27.040235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-101f89a4-e8a5-479b-8319-5b896418b077 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1367 microversion: 2.1 time: 0.160054 Sep 24 14:39:27.040804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 524/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:26 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:28.064431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:28.065123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:28.067506 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:28.073059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:28.073542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:28.073971 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:28.074648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:28.075124 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:28.075544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:28.209827 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:28.217424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c7fa8019-a5b4-4a3a-ab3e-4bb2199483e6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1367 microversion: 2.1 time: 0.157240 Sep 24 14:39:28.217989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 545/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:28 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:39:29.240414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:29.241026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:29.247312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:29.247787 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:29.248221 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:29.248885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:29.249326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:29.249739 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:29.377735 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:29.385244 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-096e5313-d24f-4a2d-9045-d341fd62ecea tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1367 microversion: 2.1 time: 0.148648 Sep 24 14:39:29.385805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 525/1070] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:29 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:30.408724 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:30.409372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:30.415919 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:30.416408 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:30.416845 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:30.417531 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:30.417983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:30.418408 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:30.544301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:30.551884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1fd3cce7-7dc9-47fd-8a15-dd16130d0883 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1367 microversion: 2.1 time: 0.147913 Sep 24 14:39:30.552449 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 546/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:30 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:30.996419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-0efb322a-a35e-49c9-bc22-b087e8555c2f req-eb745cd1-70b1-4a54-aae4-34acc917e030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ffbba6-156b-4644-a4ef-28c5dcaffbd4", "name": "network-vif-plugged", "status": "completed", "tag": "c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:31.006879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0efb322a-a35e-49c9-bc22-b087e8555c2f req-eb745cd1-70b1-4a54-aae4-34acc917e030 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:31.007509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0efb322a-a35e-49c9-bc22-b087e8555c2f req-eb745cd1-70b1-4a54-aae4-34acc917e030 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:31.007950 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0efb322a-a35e-49c9-bc22-b087e8555c2f req-eb745cd1-70b1-4a54-aae4-34acc917e030 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:31.019028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-0efb322a-a35e-49c9-bc22-b087e8555c2f req-eb745cd1-70b1-4a54-aae4-34acc917e030 service nova] Creating event network-vif-plugged:c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321 for instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 on hv-cinder-85919 Sep 24 14:39:31.023990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-0efb322a-a35e-49c9-bc22-b087e8555c2f req-eb745cd1-70b1-4a54-aae4-34acc917e030 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Sep 24 14:39:31.024757 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 526/1072] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:31.575589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:31.576129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:31.582334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:31.582822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:31.583262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:31.583936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:31.584381 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:31.584799 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:31.714539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:31.722593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c343460e-576b-4b27-9b5b-a8afac341c76 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1367 microversion: 2.1 time: 0.150959 Sep 24 14:39:31.723178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 547/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:31 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:32.746594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:32.747235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:32.755488 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:32.755995 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:32.756434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:32.757145 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:32.757597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:32.758026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:32.890678 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:32.899177 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3cf3c8eb-3570-4b2f-829e-1ac0edebe93f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1367 microversion: 2.1 time: 0.157394 Sep 24 14:39:32.899732 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 527/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:32 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:33.922787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:33.923420 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:33.925742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:33.926412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:33.932106 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:33.932586 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:33.933016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:33.933691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:33.934138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:33.934558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:34.061407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:34.068921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9cc27490-56c5-4db5-8b41-e3c398c0d817 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1557 microversion: 2.1 time: 0.150024 Sep 24 14:39:34.069476 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 548/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:33 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:34.091335 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:34.091846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:34.093866 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:34.099815 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:34.100289 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:34.100723 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:34.101396 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:34.101841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:34.102277 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:34.176251 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0c4e9e84-b696-4621-8793-8e7bfd5801c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088765 Sep 24 14:39:34.176834 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 528/1076] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:39:34 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:35.088236 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-741bff5b-7c8f-41d5-89c8-6c358a30a33e req-eceaba70-5dae-4366-a8d5-89056b6d1e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ffbba6-156b-4644-a4ef-28c5dcaffbd4", "tag": "c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:35.098346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-741bff5b-7c8f-41d5-89c8-6c358a30a33e req-eceaba70-5dae-4366-a8d5-89056b6d1e0e service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:35.098846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-741bff5b-7c8f-41d5-89c8-6c358a30a33e req-eceaba70-5dae-4366-a8d5-89056b6d1e0e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:35.099289 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-741bff5b-7c8f-41d5-89c8-6c358a30a33e req-eceaba70-5dae-4366-a8d5-89056b6d1e0e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:35.110035 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-741bff5b-7c8f-41d5-89c8-6c358a30a33e req-eceaba70-5dae-4366-a8d5-89056b6d1e0e service nova] Creating event network-changed:c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321 for instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 on hv-cinder-85919 Sep 24 14:39:35.115757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-741bff5b-7c8f-41d5-89c8-6c358a30a33e req-eceaba70-5dae-4366-a8d5-89056b6d1e0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031224 Sep 24 14:39:35.116431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 549/1077] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:52.842376 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:52.843262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=31 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:52.847555 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:52.848066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:52.855701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:52.856179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:52.856611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:52.857286 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:52.857733 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:52.858150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:52.883252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:39:52.957166 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-66c3afb6-9986-48da-875b-b4284f4e354a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 204 len: 0 microversion: 2.1 time: 0.115579 Sep 24 14:39:52.957804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 529/1078] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:39:52 2022] DELETE /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:39:52.963989 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=9 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:52.964760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=35 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:39:52.969141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:52.969832 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:52.977201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:52.977683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:52.978110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:52.978779 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:52.979250 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:52.979666 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:53.111841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:53.119578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b0dad16e-0b3c-4da7-b55e-f4fee7e768b4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1578 microversion: 2.1 time: 0.157293 Sep 24 14:39:53.120144 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 550/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:52 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:54.143288 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:54.143989 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:54.150248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:54.150734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:54.151201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:54.151879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:54.152328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:54.152749 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:54.282225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:54.290207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1bf64506-f85b-4ac2-84bc-4891834c15d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1578 microversion: 2.1 time: 0.151136 Sep 24 14:39:54.290768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 530/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:54 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:55.313503 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:55.314132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:55.322968 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:55.323449 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:55.323877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:55.324563 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:55.325011 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:55.325425 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:55.549357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:55.558271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8cb87d4f-687a-4055-a4b5-b68342379e4d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1578 microversion: 2.1 time: 0.248655 Sep 24 14:39:55.558854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 551/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:55 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1578 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:55.875033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-4799c18d-ba0d-4876-acb0-837f6ff88ced req-a26c5f27-792a-4098-a990-0d57404c9d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706136cf-b0bb-4a89-951d-a22ef9428b0b", "name": "network-vif-deleted", "tag": "bd613a7c-65b3-44db-ac85-45e7485d8eab"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:55.885849 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4799c18d-ba0d-4876-acb0-837f6ff88ced req-a26c5f27-792a-4098-a990-0d57404c9d3f service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:55.886360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4799c18d-ba0d-4876-acb0-837f6ff88ced req-a26c5f27-792a-4098-a990-0d57404c9d3f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:55.886781 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4799c18d-ba0d-4876-acb0-837f6ff88ced req-a26c5f27-792a-4098-a990-0d57404c9d3f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:55.898210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-4799c18d-ba0d-4876-acb0-837f6ff88ced req-a26c5f27-792a-4098-a990-0d57404c9d3f service nova] Creating event network-vif-deleted:bd613a7c-65b3-44db-ac85-45e7485d8eab for instance 706136cf-b0bb-4a89-951d-a22ef9428b0b on hv-cinder-85919 Sep 24 14:39:55.903282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-4799c18d-ba0d-4876-acb0-837f6ff88ced req-a26c5f27-792a-4098-a990-0d57404c9d3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031700 Sep 24 14:39:55.904212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 531/1082] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:39:56.581981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:56.582589 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:56.589107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:56.589851 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:56.590126 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:56.591865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:56.591865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:56.592921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:56.630548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:56.631065 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:56.631495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:56.632162 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lazy-loading 'fault' on Instance uuid 706136cf-b0bb-4a89-951d-a22ef9428b0b {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:39:56.675368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:56.687225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1fbc139c-36ed-4a68-8b07-e8d1db7a5325 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 200 len: 1230 microversion: 2.1 time: 0.109160 Sep 24 14:39:56.688174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 552/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:56 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:57.711926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:57.712614 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:57.718620 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:57.719123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:57.719552 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:57.720220 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:57.720663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:57.721624 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:57.742415 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] HTTP exception thrown: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Request method failure captured: Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b HTTP/1.1 Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxXinELuSKnz0zFqj_QVIvrTr9-T912ihopNRWhnHayGuPUpODgBQaIpQY-6aRzG-4dVS6jxhgigoqh4NxJyhSNaUXKmLhD-deqf1rJCg4gtrf6-cvF_QzPqBQ5vepWBi3Qk8uxa9Ckj_M1ML3WNNimurpF4wO9qYtJE5Jd4lud7PgM Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:39:57.743988 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f69d85fa8dc545efb55a0b2949e9f06c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f69d85fa8dc545efb55a0b2949e9f06c"}]}] Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: ffe9a464991e4965a0638d0c23b17ae7 Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:39:57.745711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '706136cf-b0bb-4a89-951d-a22ef9428b0b'} Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:39:57.746937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:39:57.748617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:39:57.750042 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Returning 404 to user: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:39:57.750042 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a2f35a17-3b6e-4768-8f5d-805a4723dd83 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 404 len: 111 microversion: 2.1 time: 0.038200 Sep 24 14:39:57.750042 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 532/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:57 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:39:57.840830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-893702603", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2083695467", "security_groups": [{"name": "tempest-secgroup-smoke-1381824746"}], "block_device_mapping_v2": [{"uuid": "f0998fd9-566e-4cb5-9cbc-80112916f8d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48c641d5-f10b-46bc-b665-df597be281fe"}]}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:39:57.951858 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] validate_networks() for [('48c641d5-f10b-46bc-b665-df597be281fe', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:39:58.322298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:39:58.322723 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:39:58.323239 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:39:58.323685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:39:58.324099 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:39:58.333329 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:58.333812 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:58.334252 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:58.335024 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:58.335488 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:58.335916 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:58.352457 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:39:58.356359 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for user ffe9a464991e4965a0638d0c23b17ae7 and project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:39:58.418995 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:39:58.421453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0998fd9-566e-4cb5-9cbc-80112916f8d7',volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:39:58.547096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9f9f4838-344e-4b94-98ba-bc59e96beb10 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710017 Sep 24 14:39:58.547743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 553/1085] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:39:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:39:58.558882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-676f13b7-b0d8-4077-bfbc-439fdb57a8a6 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:58.559496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-676f13b7-b0d8-4077-bfbc-439fdb57a8a6 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:58.615263 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-676f13b7-b0d8-4077-bfbc-439fdb57a8a6 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:58.622142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-676f13b7-b0d8-4077-bfbc-439fdb57a8a6 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1094 microversion: 2.1 time: 0.067117 Sep 24 14:39:58.622750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 533/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:58 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:39:59.646363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:39:59.647011 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:39:59.653669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:59.654396 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:59.654856 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:59.655556 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:39:59.656174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:39:59.656761 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:39:59.750072 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:39:59.758492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1d77db3a-122c-4c35-a1f6-0b7636232c05 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1200 microversion: 2.1 time: 0.117145 Sep 24 14:39:59.759087 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 554/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:39:59 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1200 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:00.781500 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:00.782111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:00.792213 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:00.792702 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:00.793142 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:00.794160 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:00.794609 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:00.795063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:00.934264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:00.942439 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-10d4d3e8-928d-4f21-bf44-e11a6a4ee636 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.164755 Sep 24 14:40:00.943039 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 534/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:00 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:01.333623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-6db52b5c-dd16-4d24-a64d-0842991aaff9 req-2f124ef9-c19b-4df9-ba8a-9392df328bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d37bc53-2176-4fcf-abab-a9771cb0667f", "tag": "2bd0d195-ca08-40d0-a830-a7c73d18e828"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:01.346821 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6db52b5c-dd16-4d24-a64d-0842991aaff9 req-2f124ef9-c19b-4df9-ba8a-9392df328bbc service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:01.347314 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6db52b5c-dd16-4d24-a64d-0842991aaff9 req-2f124ef9-c19b-4df9-ba8a-9392df328bbc service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:01.347749 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6db52b5c-dd16-4d24-a64d-0842991aaff9 req-2f124ef9-c19b-4df9-ba8a-9392df328bbc service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:01.358944 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-6db52b5c-dd16-4d24-a64d-0842991aaff9 req-2f124ef9-c19b-4df9-ba8a-9392df328bbc service nova] Creating event network-changed:2bd0d195-ca08-40d0-a830-a7c73d18e828 for instance 0d37bc53-2176-4fcf-abab-a9771cb0667f on hv-cinder-85919 Sep 24 14:40:01.363852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-6db52b5c-dd16-4d24-a64d-0842991aaff9 req-2f124ef9-c19b-4df9-ba8a-9392df328bbc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035574 Sep 24 14:40:01.364429 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 555/1089] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:40:01.965493 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:01.966040 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:01.972897 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:01.973373 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:01.973804 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:01.974482 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:01.974964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:01.975389 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:02.105467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:02.113820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-02e2c719-19ae-4b13-8740-9d1af6cff2a1 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.152237 Sep 24 14:40:02.114379 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 535/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:01 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:03.136414 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:03.137107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:03.143158 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:03.143635 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:03.144068 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:03.144743 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:03.145193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:03.145610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:03.355926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:03.363831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-92332c9a-f247-4530-8a2d-76bb9d629c6f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.232101 Sep 24 14:40:03.364683 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 556/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:03 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:04.387632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:04.388240 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:04.395063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:04.395554 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:04.395991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:04.396672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:04.397125 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:04.397548 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:04.526349 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:04.534304 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ea48204b-5715-42c6-ba62-bfb6136b716b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.150610 Sep 24 14:40:04.534885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 536/1092] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:04 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:05.556550 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:05.557161 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:05.563035 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:05.563504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:05.563937 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:05.564618 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:05.565070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:05.565493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:05.698804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:05.707238 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-85e0fcff-c90a-40b7-b8e9-d1ce3341babc tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.154032 Sep 24 14:40:05.707822 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 557/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:05 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:06.729567 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:06.730124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:06.736563 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:06.737038 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:06.737468 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:06.738720 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:06.739190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:06.739606 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:06.870293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:06.877889 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b7853afe-a455-4c2c-abf1-5e2c6c8846f4 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.152259 Sep 24 14:40:06.878462 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 537/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:06 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:07.900217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:07.900827 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:07.907676 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:07.908193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:07.908884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:07.909564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:07.910013 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:07.910432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:08.036888 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:08.044477 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ed61eaa9-c80a-4d7e-a5b0-412fc34f4c84 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.148141 Sep 24 14:40:08.045030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 558/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:07 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:09.068116 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:09.068654 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:09.071442 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:09.076786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:09.077257 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:09.077684 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:09.078354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:09.078797 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:09.079238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:09.205801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:09.213255 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3e26fa25-074c-4ba6-b807-c8af15e79b59 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.149551 Sep 24 14:40:09.213811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 538/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:09 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:10.235587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:10.236199 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:10.238753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:10.239419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:10.245537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:10.246019 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:10.246454 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:10.247180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:10.247630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:10.248050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:10.380663 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:10.388139 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6e377936-c87b-44e5-8c2b-896d114c88b3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.156485 Sep 24 14:40:10.388693 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 559/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:10 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:11.410426 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:11.411067 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:11.417542 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:11.418025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:11.418461 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:11.419181 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:11.419635 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:11.420065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:11.551784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:11.559394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0b5774ed-b70e-4309-9fa9-cc24d3f1195f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.153836 Sep 24 14:40:11.559955 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 539/1098] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:11 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:12.581671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:12.582416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:12.588854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:12.589334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:12.589783 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:12.590447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:12.590932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:12.591352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:12.719838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:12.728804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-505aee96-cd43-4927-a330-72379f55d7e2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.151151 Sep 24 14:40:12.729364 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 560/1099] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:12 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:13.103439 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-43607852-a1cb-4ce0-83cd-ddec12381644 req-dbaa07dd-41d4-426a-a568-994a2ba3a392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d37bc53-2176-4fcf-abab-a9771cb0667f", "name": "network-vif-plugged", "status": "completed", "tag": "2bd0d195-ca08-40d0-a830-a7c73d18e828"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:13.114259 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-43607852-a1cb-4ce0-83cd-ddec12381644 req-dbaa07dd-41d4-426a-a568-994a2ba3a392 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:13.114735 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-43607852-a1cb-4ce0-83cd-ddec12381644 req-dbaa07dd-41d4-426a-a568-994a2ba3a392 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:13.115199 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-43607852-a1cb-4ce0-83cd-ddec12381644 req-dbaa07dd-41d4-426a-a568-994a2ba3a392 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:13.126048 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-43607852-a1cb-4ce0-83cd-ddec12381644 req-dbaa07dd-41d4-426a-a568-994a2ba3a392 service nova] Creating event network-vif-plugged:2bd0d195-ca08-40d0-a830-a7c73d18e828 for instance 0d37bc53-2176-4fcf-abab-a9771cb0667f on hv-cinder-85919 Sep 24 14:40:13.131013 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-43607852-a1cb-4ce0-83cd-ddec12381644 req-dbaa07dd-41d4-426a-a568-994a2ba3a392 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 Sep 24 14:40:13.131774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 540/1100] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:40:13.751856 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:13.752409 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:13.759399 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:13.759876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:13.760302 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:13.760974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:13.761419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:13.761835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:13.898830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:13.906411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-03d2a216-f614-423a-b61b-075e7d7ceef0 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1266 microversion: 2.1 time: 0.158524 Sep 24 14:40:13.906995 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 561/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:13 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:14.930496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:14.931219 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:14.937312 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:14.937784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:14.938212 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:14.938919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:14.939365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:14.939778 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:15.070700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:15.078967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0eca2b3f-9347-4958-8cf5-2f2399ea234c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1453 microversion: 2.1 time: 0.153767 Sep 24 14:40:15.079542 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 541/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:14 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:15.101763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:15.102305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:15.108619 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:15.109093 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:15.109522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:15.110191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:15.110637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:15.111075 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:15.237716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:15.245297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6508df55-7e1e-4e0d-b7ac-1fe4eed79f53 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1453 microversion: 2.1 time: 0.148003 Sep 24 14:40:15.245855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 562/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:15 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:17.029472 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-1e5fe850-1dde-4ce5-808b-dd9e7277d5f0 req-6721291d-3e6b-4e13-8834-ab6f79fe60e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d37bc53-2176-4fcf-abab-a9771cb0667f", "tag": "2bd0d195-ca08-40d0-a830-a7c73d18e828"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:17.040105 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-1e5fe850-1dde-4ce5-808b-dd9e7277d5f0 req-6721291d-3e6b-4e13-8834-ab6f79fe60e9 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:17.040583 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-1e5fe850-1dde-4ce5-808b-dd9e7277d5f0 req-6721291d-3e6b-4e13-8834-ab6f79fe60e9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:17.041013 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-1e5fe850-1dde-4ce5-808b-dd9e7277d5f0 req-6721291d-3e6b-4e13-8834-ab6f79fe60e9 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:17.199782 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-1e5fe850-1dde-4ce5-808b-dd9e7277d5f0 req-6721291d-3e6b-4e13-8834-ab6f79fe60e9 service nova] Creating event network-changed:2bd0d195-ca08-40d0-a830-a7c73d18e828 for instance 0d37bc53-2176-4fcf-abab-a9771cb0667f on hv-cinder-85919 Sep 24 14:40:17.204784 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-1e5fe850-1dde-4ce5-808b-dd9e7277d5f0 req-6721291d-3e6b-4e13-8834-ab6f79fe60e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178966 Sep 24 14:40:17.205551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 542/1104] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:40:17.879892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:17.880374 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:17.888148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:17.888634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:17.889067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:17.889769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:17.890225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:17.890648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:17.914685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7bdc9004-6445-46cf-8eff-fa81bdd4d9b0 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/ips" status: 200 len: 147 microversion: 2.1 time: 0.038675 Sep 24 14:40:17.915373 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 563/1105] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:40:17 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:40:20.838882 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55afa9df-0bc9-4ec3-9c6c-7839bbb7856e"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:20.841593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:20.848150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:20.848630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:20.849059 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:20.849736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:20.850184 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:20.850603 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:21.118486 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d54c6f94-c604-46ef-980a-9843eaf91049 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284889 Sep 24 14:40:21.119204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 543/1106] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:40:20 2022] POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:40:28.648465 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8dc52428-58a6-4ff4-9a49-c91e8acc9054 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:28.650998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:28.651637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=76 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:28.657902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8dc52428-58a6-4ff4-9a49-c91e8acc9054 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:28.658382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8dc52428-58a6-4ff4-9a49-c91e8acc9054 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:28.658806 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8dc52428-58a6-4ff4-9a49-c91e8acc9054 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:28.718024 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8dc52428-58a6-4ff4-9a49-c91e8acc9054 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Going to try to stop instance {{(pid=120744) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 14:40:28.758687 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8dc52428-58a6-4ff4-9a49-c91e8acc9054 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action" status: 202 len: 0 microversion: 2.1 time: 0.114053 Sep 24 14:40:28.759360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 564/1107] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:40:28 2022] POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:40:28.768328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:28.769565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:28.771509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:28.777315 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:28.777808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:28.778282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:28.778995 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:28.779446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:28.779877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:28.782926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:28.913662 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:28.921909 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3451b0b2-cc4f-4199-b28a-0d38389e65da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.158243 Sep 24 14:40:28.922459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 544/1108] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:28 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:29.946088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:29.946776 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:29.952841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:29.953319 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:29.953744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:29.954416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:29.954889 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:29.955307 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:30.085300 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:30.093388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-230c8026-4f6b-44dd-bf2d-a7bb8c0986f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.151971 Sep 24 14:40:30.093951 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 565/1109] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:29 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:31.116712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:31.117253 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:31.123812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:31.124295 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:31.124727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:31.125404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:31.125855 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:31.126274 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:31.248992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:31.257052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e5c7d72b-7c6f-48c5-aa3e-6c7fb6a578dd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.144885 Sep 24 14:40:31.257604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 545/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:31 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:32.280017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:32.280623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:32.287336 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:32.287813 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:32.288246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:32.288923 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:32.289375 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:32.289795 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:32.415574 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:32.423637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5f5047b9-e1da-45a8-8efe-460572d931fe tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.147497 Sep 24 14:40:32.424205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 566/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:32 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:33.447753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:33.448361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:33.454690 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:33.455201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:33.455636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:33.456937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:33.457390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:33.457812 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:33.584298 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:33.592439 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-50e03cf9-6833-41ba-a98b-9cb5c637167c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.148626 Sep 24 14:40:33.592983 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 546/1112] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:33 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:34.615546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:34.616148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:34.622133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:34.622610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:34.623072 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:34.623745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:34.624191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:34.624604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:34.755840 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:34.763999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5c328e7c-4f1f-41bc-a657-4f5aa8220c26 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.152413 Sep 24 14:40:34.764549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 567/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:34 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:35.788384 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:35.788992 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:35.795226 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:35.795701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:35.796159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:35.796833 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:35.797276 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:35.797691 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:35.922024 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:35.930086 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0281aaaf-ff88-4168-a245-30a93ea9de2b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.146216 Sep 24 14:40:35.930636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 547/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:35 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:36.954872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:36.955502 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:36.961921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:36.962407 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:36.962863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:36.963555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:36.964006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:36.964431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:37.089512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:37.098117 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2063184e-8d13-40e0-b690-28e2e71416ca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.147212 Sep 24 14:40:37.098671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 568/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:36 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:38.121883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:38.122407 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:38.129299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:38.129774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:38.130206 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:38.130904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:38.131354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:38.131768 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:38.255402 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:38.263384 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-491dd587-e475-4e7b-b240-c91fd17f0600 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1723 microversion: 2.1 time: 0.145504 Sep 24 14:40:38.263931 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 548/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:38 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:39.286952 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:39.287560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:39.293977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:39.294458 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:39.294913 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:39.295597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:39.296049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:39.296470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:39.424893 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:39.433061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a6afb076-ce4b-4bbf-bb4b-73b8aaf9fbeb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1700 microversion: 2.1 time: 0.150339 Sep 24 14:40:39.433623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 569/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:39 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:39.456513 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cce9c0fd-557b-486b-89b1-ecc4fe167b43 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:39.462902 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cce9c0fd-557b-486b-89b1-ecc4fe167b43 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:39.463381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cce9c0fd-557b-486b-89b1-ecc4fe167b43 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:39.463811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cce9c0fd-557b-486b-89b1-ecc4fe167b43 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:39.521991 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cce9c0fd-557b-486b-89b1-ecc4fe167b43 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Going to try to start instance {{(pid=120743) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 14:40:39.561019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cce9c0fd-557b-486b-89b1-ecc4fe167b43 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action" status: 202 len: 0 microversion: 2.1 time: 0.108747 Sep 24 14:40:39.561520 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 549/1118] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:40:39 2022] POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:40:39.570759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:39.571478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:39.577648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:39.578180 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:39.578652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:39.579443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:39.579900 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:39.580390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:39.726595 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:39.735287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-efd90e66-3f3e-4404-8b61-74a7d532d1f3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1709 microversion: 2.1 time: 0.168343 Sep 24 14:40:39.735973 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 570/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:39 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:40.760920 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:40.761537 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:40.767669 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:40.768152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:40.769215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:40.769905 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:40.770365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:40.770792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:40.901235 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:40.909586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c779dcab-31d4-4f34-b739-8c392e7830cf tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1709 microversion: 2.1 time: 0.153267 Sep 24 14:40:40.910134 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 550/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:40 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:41.932810 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:41.933414 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:41.939857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:41.940333 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:41.940764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:41.941436 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:41.941880 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:41.942294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:42.073041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:40:42.081567 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3325ae8e-25ac-442c-b1b9-588cdaf3cffb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1713 microversion: 2.1 time: 0.152087 Sep 24 14:40:42.082126 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 571/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:40:41 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:40:50.232479 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:50.233018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:50.239317 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:50.239783 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:50.240207 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:50.240876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:50.241318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:50.241730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:50.264352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-59ca7ae7-15f6-4557-b2aa-d242aeba3244 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/ips" status: 200 len: 149 microversion: 2.1 time: 0.091070 Sep 24 14:40:50.264884 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 551/1122] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:40:50 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:40:51.596176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fc7023f-72d0-498e-ba99-9561ae8b1256"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:51.598518 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:51.605104 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:51.605590 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:51.606030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:51.606712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:51.607202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:51.607629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:51.873046 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e52a3939-211c-469e-9c23-77f9524e4397 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280715 Sep 24 14:40:51.873636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 572/1123] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:40:51 2022] POST /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:40:59.413854 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fc7023f-72d0-498e-ba99-9561ae8b1256"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:40:59.416279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:59.418644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=16 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:59.423919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:59.424419 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:59.424850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:59.425526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:59.425971 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:59.426394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:59.430062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:59.505215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Invalid volume: volume 5fc7023f-72d0-498e-ba99-9561ae8b1256 is already attached to instances: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: POST /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments HTTP/1.1 Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 74 Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:40:59.507204 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {"volumeAttachment": {"volumeId": "5fc7023f-72d0-498e-ba99-9561ae8b1256"}} Sep 24 14:40:59.509000 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Invalid volume: volume 5fc7023f-72d0-498e-ba99-9561ae8b1256 is already attached to instances: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'server_id': '18ffbba6-156b-4644-a4ef-28c5dcaffbd4', 'body': {'volumeAttachment': {'volumeId': '5fc7023f-72d0-498e-ba99-9561ae8b1256'}}} Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5fc7023f-72d0-498e-ba99-9561ae8b1256 is already attached to instances: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:40:59.510150 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5fc7023f-72d0-498e-ba99-9561ae8b1256 is already attached to instances: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:40:59.511704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5fc7023f-72d0-498e-ba99-9561ae8b1256 is already attached to instances: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 400 to user: Invalid volume: volume 5fc7023f-72d0-498e-ba99-9561ae8b1256 is already attached to instances: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0c089781-7ed5-494f-b4e9-3901a5f5dfcd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099032 Sep 24 14:40:59.513416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 552/1124] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:40:59 2022] POST /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 14:40:59.575120 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:59.575700 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:59.577671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=19 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:59.583685 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:59.584170 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:59.584607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:59.585294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:59.585750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:59.586177 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:59.590179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:59.667201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lazy-loading 'services' on Instance uuid 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:40:59.738145 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c7cb45f9-3b13-481e-829e-58c1e1e8e32c tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments/5fc7023f-72d0-498e-ba99-9561ae8b1256" status: 202 len: 0 microversion: 2.1 time: 0.167610 Sep 24 14:40:59.738730 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 573/1125] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:40:59 2022] DELETE /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments/5fc7023f-72d0-498e-ba99-9561ae8b1256 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:40:59.747020 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:40:59.749140 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:40:59.756569 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:59.756990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:59.757443 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:59.758137 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:40:59.758584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:40:59.759028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:40:59.788956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9bff55b7-5ea7-4577-9160-baf706cd270e tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045874 Sep 24 14:40:59.789500 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 553/1126] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:40:59 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:41:00.802921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:00.805232 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:00.811380 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:00.811863 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:00.812293 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:00.812974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:00.813424 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:00.813843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:00.844202 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-970cbd6c-31de-474a-82d6-c66daecb0fb6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046468 Sep 24 14:41:00.844956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 574/1127] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:41:00 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:41:00.912210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:00.912713 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:00.919138 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:00.919617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:00.920049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:00.920729 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:00.921180 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:00.921600 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:00.948948 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:41:01.021712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-262afec1-821e-45d7-8c43-e4c5b94dc92a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 204 len: 0 microversion: 2.1 time: 0.113508 Sep 24 14:41:01.022518 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 554/1128] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:41:00 2022] DELETE /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:41:01.031128 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:01.031771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:01.038447 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:01.038992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:01.039433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:01.040152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:01.040596 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:01.041016 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:01.169201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:01.177403 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cd48c070-9cd0-4936-ac7a-8e45a507a654 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1681 microversion: 2.1 time: 0.150234 Sep 24 14:41:01.177950 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 575/1129] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:01 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:02.200899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:02.201601 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:02.208399 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:02.208878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:02.209310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:02.209990 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:02.210434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:02.210878 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:02.340721 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:02.348947 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c8dd4b5e-6128-49dd-af70-40155049dc87 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1681 microversion: 2.1 time: 0.152301 Sep 24 14:41:02.349512 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 555/1130] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:02 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:03.372265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:03.372871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:03.379340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:03.379823 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:03.380255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:03.380940 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:03.381391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:03.381814 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:03.615979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:03.623596 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3690e90b-d16f-4e46-8b03-d185aeb68f45 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1681 microversion: 2.1 time: 0.255263 Sep 24 14:41:03.624363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 576/1131] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:03 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:04.371164 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-0501cc38-0a0f-481b-af88-c78a8c8958de req-bf89052d-ed43-43cb-bc63-8d87d76e9f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ffbba6-156b-4644-a4ef-28c5dcaffbd4", "name": "network-vif-deleted", "tag": "c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:41:04.383647 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0501cc38-0a0f-481b-af88-c78a8c8958de req-bf89052d-ed43-43cb-bc63-8d87d76e9f57 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:04.384282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0501cc38-0a0f-481b-af88-c78a8c8958de req-bf89052d-ed43-43cb-bc63-8d87d76e9f57 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:04.384716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-0501cc38-0a0f-481b-af88-c78a8c8958de req-bf89052d-ed43-43cb-bc63-8d87d76e9f57 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:04.402982 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-0501cc38-0a0f-481b-af88-c78a8c8958de req-bf89052d-ed43-43cb-bc63-8d87d76e9f57 service nova] Creating event network-vif-deleted:c0d3fe8d-55e3-4ecd-97ca-9b788ae5d321 for instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 on hv-cinder-85919 Sep 24 14:41:04.407841 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-0501cc38-0a0f-481b-af88-c78a8c8958de req-bf89052d-ed43-43cb-bc63-8d87d76e9f57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041824 Sep 24 14:41:04.408452 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 556/1132] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:41:04.647003 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:04.647999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:04.654702 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:04.655217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:04.655646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:04.656330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:04.656783 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:04.657196 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:04.690764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:04.691271 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:04.692041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:04.692435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lazy-loading 'fault' on Instance uuid 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:41:04.732962 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:04.741711 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7bc95194-1891-443d-8360-713029f521dc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 200 len: 1331 microversion: 2.1 time: 0.098713 Sep 24 14:41:04.742274 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 577/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:04 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:05.765704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:05.766394 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:05.773215 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:05.773694 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:05.774122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:05.774794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:05.775338 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:05.775759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:05.789930 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 HTTP/1.1 Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:41:05.791557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:41:05.793264 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '18ffbba6-156b-4644-a4ef-28c5dcaffbd4'} Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:41:05.794197 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:41:05.795755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:41:05.797122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:41:05.797122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-88d3df17-b936-49b4-b510-c5a1fdab28ff tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 404 len: 111 microversion: 2.1 time: 0.031924 Sep 24 14:41:05.797122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 557/1134] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:05 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:41:05.801593 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3101209a-48c0-4dca-a4a1-fa73a92cf0e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '.version_select at 0x7f222e38bf70>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:05.820926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3101209a-48c0-4dca-a4a1-fa73a92cf0e5 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765717140" status: 202 len: 0 microversion: 2.1 time: 0.023077 Sep 24 14:41:05.821495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 578/1135] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 14:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765717140 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:41:06.419443 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2614caa3-7848-4cc1-a100-d69848a8adee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: .version_select at 0x7f222aa19f70>, body: {"keypair": {"name": "tempest-keypair-1308458409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqKZgr7Vh72OU11kJ8pp10n3cZHjzQrJmv27xxRUeYyhxvLOrfPSmVOzkPbfZo7VfX1pfLVWOtIVLRucAGBzNeutvGs4qbm1phk+fuoEX3wyrE2wPmT3V8NPZ+armSamQ=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:41:06.434328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-2614caa3-7848-4cc1-a100-d69848a8adee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:41:06.438397 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-2614caa3-7848-4cc1-a100-d69848a8adee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:41:06.460856 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2614caa3-7848-4cc1-a100-d69848a8adee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045326 Sep 24 14:41:06.461417 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 558/1136] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:41:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:41:07.652161 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-246611310", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd29c2a7-29a9-46cb-ada7-34fd38591f69"}], "security_groups": [{"name": "tempest-securitygroup--2028353506"}], "key_name": "tempest-keypair-1308458409", "user_data": "}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:41:07.755298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] validate_networks() for [('dd29c2a7-29a9-46cb-ada7-34fd38591f69', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:41:08.119301 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:41:08.119720 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:41:08.120187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:41:08.120588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:41:08.120990 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:41:08.130276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:08.130750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:08.131206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:08.131921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:08.132369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:08.132785 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:08.148811 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:41:08.152747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Getting quotas for user abb529f39710407abf9d6e1cedd9a603 and project 21710ac430424ec9bf33aabfda5eb8ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:41:08.163624 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:41:08.165870 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:41:08.211775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-10d929ec-d812-4f76-963e-428f2a7f2490 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563900 Sep 24 14:41:08.212415 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 579/1137] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:41:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:41:08.223790 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b6669cf8-ed46-48d4-8388-c5ec7e1857fd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:08.224406 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b6669cf8-ed46-48d4-8388-c5ec7e1857fd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:08.284629 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b6669cf8-ed46-48d4-8388-c5ec7e1857fd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:08.292539 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b6669cf8-ed46-48d4-8388-c5ec7e1857fd tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1241 microversion: 2.1 time: 0.072793 Sep 24 14:41:08.293092 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 559/1138] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:08 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:09.316577 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:09.317110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:09.323815 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:09.324295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:09.324909 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:09.325591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:09.326039 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:09.326456 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:09.394129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:09.401712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-8e3cf6cd-6a0a-4247-be0d-f41c4df34e6f tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1293 microversion: 2.1 time: 0.090085 Sep 24 14:41:09.413696 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 580/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:09 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:10.425319 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:10.425877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:10.432538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:10.433015 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:10.433447 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:10.434123 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:10.434567 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:10.435008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:10.563261 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:10.571375 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1c95491b-e2ae-4a28-82af-3f43adb21cb7 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.150320 Sep 24 14:41:10.571937 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 560/1140] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:10 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:10.922857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-a1351b43-156b-45e5-8e00-bf385657636b req-6c467f48-4af4-40eb-aaf1-0590aad0f2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e460b5e2-3d4d-4493-b06c-ab6d5b037c65", "tag": "f999005f-69b1-4114-9abd-3afe92094553"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:41:10.937305 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-a1351b43-156b-45e5-8e00-bf385657636b req-6c467f48-4af4-40eb-aaf1-0590aad0f2a4 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:10.938114 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-a1351b43-156b-45e5-8e00-bf385657636b req-6c467f48-4af4-40eb-aaf1-0590aad0f2a4 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:10.938725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-a1351b43-156b-45e5-8e00-bf385657636b req-6c467f48-4af4-40eb-aaf1-0590aad0f2a4 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:10.950833 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-a1351b43-156b-45e5-8e00-bf385657636b req-6c467f48-4af4-40eb-aaf1-0590aad0f2a4 service nova] Creating event network-changed:f999005f-69b1-4114-9abd-3afe92094553 for instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 on hv-cinder-85919 Sep 24 14:41:10.955939 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-a1351b43-156b-45e5-8e00-bf385657636b req-6c467f48-4af4-40eb-aaf1-0590aad0f2a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037614 Sep 24 14:41:10.956524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 581/1141] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:41:11.595327 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:11.595859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:11.602357 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:11.602887 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:11.603343 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:11.604016 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:11.604462 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:11.604877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:11.730509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:11.738582 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-84116b02-bd14-46ea-a29e-7d583dec7369 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.147231 Sep 24 14:41:11.739170 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 561/1142] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:11 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:12.762473 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:12.763135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:12.770129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:12.770605 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:12.771059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:12.771733 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:12.772176 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:12.772620 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:12.899938 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:12.907769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-533f22bf-1f3b-460b-8e64-8f1dcc95f1f1 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.149236 Sep 24 14:41:12.908326 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 582/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:12 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:13.931179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:13.931821 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:13.938362 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:13.938863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:13.939297 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:13.939974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:13.940440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:13.940858 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:14.080269 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:14.088570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7df9a498-535f-4b22-92b0-4923e9805f3b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.161171 Sep 24 14:41:14.089070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 562/1144] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:13 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:15.112380 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:15.112921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:15.119401 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:15.119874 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:15.120299 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:15.120974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:15.121416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:15.121838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:15.247879 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:15.255948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f3bfd17f-4094-425d-9d02-1b8bd7d78301 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.147482 Sep 24 14:41:15.256511 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 583/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:15 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:16.279251 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:16.279885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:16.287117 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:16.287593 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:16.288020 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:16.288687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:16.289163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:16.289576 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:16.460171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:16.467960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3869818e-dfb5-4291-b2da-16c298a56a5a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.192565 Sep 24 14:41:16.468525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 563/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:16 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:17.371807 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-7b2fb7fe-3f1e-4531-a079-710a4174ba11 req-c751683b-58ec-499a-85f5-8371d682841c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e460b5e2-3d4d-4493-b06c-ab6d5b037c65", "name": "network-vif-plugged", "status": "completed", "tag": "f999005f-69b1-4114-9abd-3afe92094553"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:41:17.382392 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-7b2fb7fe-3f1e-4531-a079-710a4174ba11 req-c751683b-58ec-499a-85f5-8371d682841c service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:17.383148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-7b2fb7fe-3f1e-4531-a079-710a4174ba11 req-c751683b-58ec-499a-85f5-8371d682841c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:17.383317 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-7b2fb7fe-3f1e-4531-a079-710a4174ba11 req-c751683b-58ec-499a-85f5-8371d682841c service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:17.394201 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-7b2fb7fe-3f1e-4531-a079-710a4174ba11 req-c751683b-58ec-499a-85f5-8371d682841c service nova] Creating event network-vif-plugged:f999005f-69b1-4114-9abd-3afe92094553 for instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 on hv-cinder-85919 Sep 24 14:41:17.399277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-7b2fb7fe-3f1e-4531-a079-710a4174ba11 req-c751683b-58ec-499a-85f5-8371d682841c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031100 Sep 24 14:41:17.399884 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 584/1147] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:41:17.492657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:17.493267 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:17.499890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:17.500371 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:17.500805 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:17.501491 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:17.502094 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:17.502529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:17.638592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:17.646218 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c749f7fd-ac70-4ff2-9205-616ffceda636 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.157648 Sep 24 14:41:17.647079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 564/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:17 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:18.668469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:41:18.669258 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:41:18.673901 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:18.674621 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:18.681478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:18.681945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:18.682372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:18.683076 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:18.683520 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:18.683937 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:18.860275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:18.867937 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-9b0f18e0-1bf3-4ad8-bca7-b14d0a8dbd1d tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1367 microversion: 2.1 time: 0.200419 Sep 24 14:41:18.868493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 585/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:18 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:19.891152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:19.891791 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:19.893731 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:41:19.899247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:19.899724 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:19.900158 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:19.900829 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:19.901270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:19.901686 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:20.029139 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:20.037759 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-75507cf9-b53a-413b-8ad8-570ffacc7421 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1558 microversion: 2.1 time: 0.150675 Sep 24 14:41:20.038322 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 565/1150] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:19 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:20.059778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:20.060273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:20.066459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:20.066967 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:20.067394 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:20.068070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:20.068518 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:20.068934 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:20.145636 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f22d5b0e-f16e-40cb-b0b2-60306da82096 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089599 Sep 24 14:41:20.146225 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 586/1151] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:41:20 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:41:21.297259 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-bea957b0-8000-4d11-85fe-367aac47a7f7 req-a39c968c-d525-4818-b3bc-269053019b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e460b5e2-3d4d-4493-b06c-ab6d5b037c65", "tag": "f999005f-69b1-4114-9abd-3afe92094553"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:41:21.310172 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-bea957b0-8000-4d11-85fe-367aac47a7f7 req-a39c968c-d525-4818-b3bc-269053019b93 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:21.310642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-bea957b0-8000-4d11-85fe-367aac47a7f7 req-a39c968c-d525-4818-b3bc-269053019b93 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:21.311141 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-bea957b0-8000-4d11-85fe-367aac47a7f7 req-a39c968c-d525-4818-b3bc-269053019b93 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:21.323268 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-bea957b0-8000-4d11-85fe-367aac47a7f7 req-a39c968c-d525-4818-b3bc-269053019b93 service nova] Creating event network-changed:f999005f-69b1-4114-9abd-3afe92094553 for instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 on hv-cinder-85919 Sep 24 14:41:21.328331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-bea957b0-8000-4d11-85fe-367aac47a7f7 req-a39c968c-d525-4818-b3bc-269053019b93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034794 Sep 24 14:41:21.328918 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 566/1152] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:41:48.841838 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:41:48.842583 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:41:48.848109 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:48.848605 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:48.856852 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:48.857331 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:48.857760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:48.858440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:48.858926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:48.859349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:48.941154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lazy-loading 'services' on Instance uuid ee65d370-8082-417a-bb3d-5816c602da9f {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:41:49.011881 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-389de222-7f3c-4269-811b-8b55a9b61ada tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-volume_attachments/55afa9df-0bc9-4ec3-9c6c-7839bbb7856e" status: 202 len: 0 microversion: 2.1 time: 0.170789 Sep 24 14:41:49.012470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 587/1153] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:41:48 2022] DELETE /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-volume_attachments/55afa9df-0bc9-4ec3-9c6c-7839bbb7856e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:41:50.136588 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:41:50.137331 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:41:50.138410 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 14:41:50.138575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Sat Sep 24 14:41:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action (ip 10.222.0.52) !!! Sep 24 14:41:50.144224 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-26310c84-11aa-47d7-b3d4-b3fec838f03e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:41:50.153478 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26310c84-11aa-47d7-b3d4-b3fec838f03e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:50.153956 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26310c84-11aa-47d7-b3d4-b3fec838f03e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:50.154393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-26310c84-11aa-47d7-b3d4-b3fec838f03e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:50.178595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-26310c84-11aa-47d7-b3d4-b3fec838f03e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Going to try to stop instance {{(pid=120743) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 14:41:50.219642 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-26310c84-11aa-47d7-b3d4-b3fec838f03e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action" status: 202 len: 0 microversion: 2.1 time: 0.084506 Sep 24 14:41:50.220232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 567/1154] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:41:50 2022] POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:41:50.229463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:50.230154 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:50.237187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:50.237668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:50.238700 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:50.239428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:50.240056 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:50.240479 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:50.368042 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:50.375597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-93e4e652-21df-415d-8388-52faef303041 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.150312 Sep 24 14:41:50.376190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 588/1155] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:50 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:51.401200 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:51.401894 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:51.408649 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:51.409124 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:51.409557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:51.410234 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:51.410963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:51.411386 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:51.541006 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:51.548685 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-13f3a2f5-6c71-495c-abea-391f7e02b3c3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.152195 Sep 24 14:41:51.549252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 568/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:51 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:52.571691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:52.572295 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:52.579059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:52.579542 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:52.580459 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:52.581138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:52.581584 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:52.581999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:52.707326 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:52.714764 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-fe8b56df-475a-4bf5-9a66-3283cbb3ad90 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.146903 Sep 24 14:41:52.715346 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 589/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:52 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:53.737876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:53.738476 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:53.745133 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:53.745608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:53.746034 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:53.746716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:53.747187 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:53.747659 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:53.879220 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:53.886750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0be36889-0d33-4180-a8a7-f446856be031 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.153186 Sep 24 14:41:53.887320 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 569/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:53 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:54.909521 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:54.910128 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:54.916733 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:54.917208 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:54.917640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:54.918318 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:54.918774 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:54.919218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:55.046489 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:55.054044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-45207466-64fc-4cbd-ae2b-0895b65b1bcb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.148463 Sep 24 14:41:55.054607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 590/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:54 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:56.077293 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:56.077903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:56.084412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:56.084893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:56.085326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:56.086004 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:56.086459 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:56.086909 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:56.212060 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:56.219705 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b8cf8427-f3df-4e59-afc3-4cd249064321 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.146327 Sep 24 14:41:56.220270 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 570/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:56 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:57.242402 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:57.243064 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:57.249451 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:57.249929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:57.250371 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:57.251071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:57.251519 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:57.252428 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:57.377387 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:57.384994 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b6efd196-3e77-4637-a99c-58d0e269e615 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.146399 Sep 24 14:41:57.385581 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 591/1161] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:57 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:58.409340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:58.409879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:58.417201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:58.417201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:58.417456 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:58.418174 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:58.418687 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:58.419149 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:58.548680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:58.556353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b07d7f73-ae80-44b4-8cba-607236bebe0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.151668 Sep 24 14:41:58.556925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 571/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:58 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:41:59.579330 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:41:59.579997 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:41:59.586412 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:59.586929 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:59.587366 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:59.588045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:41:59.588492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:41:59.588914 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:41:59.721841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:41:59.729626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6c1e2a13-b747-49f5-b168-546724e7fd5d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1677 microversion: 2.1 time: 0.154238 Sep 24 14:41:59.730188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 592/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:41:59 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:00.753541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:00.754081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:00.760716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:00.761203 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:00.761657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:00.762395 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:00.762879 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:00.763309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:00.896946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:00.905009 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-35b05aa2-61d3-4a1a-9d72-bc879a367e1e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1654 microversion: 2.1 time: 0.155469 Sep 24 14:42:00.905603 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 572/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:00 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:00.927571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-928d7cb5-4fb4-4686-a8cf-93e7a38ba75b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:42:00.933937 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-928d7cb5-4fb4-4686-a8cf-93e7a38ba75b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:00.934419 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-928d7cb5-4fb4-4686-a8cf-93e7a38ba75b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:00.934877 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-928d7cb5-4fb4-4686-a8cf-93e7a38ba75b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:00.957539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-928d7cb5-4fb4-4686-a8cf-93e7a38ba75b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Going to try to start instance {{(pid=120744) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 14:42:00.996823 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-928d7cb5-4fb4-4686-a8cf-93e7a38ba75b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action" status: 202 len: 0 microversion: 2.1 time: 0.073005 Sep 24 14:42:00.997406 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 593/1165] 10.222.0.52 () {60 vars in 1278 bytes} [Sat Sep 24 14:42:00 2022] POST /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:42:01.006036 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:01.006575 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:01.012597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:01.013078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:01.013596 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:01.014298 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:01.014874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:01.015307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:01.147802 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:01.155540 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d434515a-9db8-4028-935f-9aeb8a9649e5 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1663 microversion: 2.1 time: 0.153958 Sep 24 14:42:01.156166 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 573/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:01 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:02.180232 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:02.180933 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:02.187015 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:02.187494 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:02.187928 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:02.188610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:02.189091 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:02.190151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:02.317307 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:02.324861 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0bdfc056-c6ed-44cf-a523-bf9428a6220f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1663 microversion: 2.1 time: 0.149338 Sep 24 14:42:02.325422 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 594/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:02 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:03.349028 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:03.349640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:03.355737 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:03.356232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:03.356650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:03.357324 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:03.357772 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:03.358222 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:03.483964 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:03.492349 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-aeabdac3-8ce7-4b4a-99fa-30bba9679c44 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1667 microversion: 2.1 time: 0.147874 Sep 24 14:42:03.492904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 574/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:03 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1667 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:18.386125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1543399412", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2083695467", "security_groups": [{"name": "tempest-secgroup-smoke-1381824746"}], "block_device_mapping_v2": [{"uuid": "cf8b68bf-5e35-482d-9322-ac4e793fce9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "48c641d5-f10b-46bc-b665-df597be281fe"}]}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:42:18.396545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=16 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:18.397191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:18.501235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] validate_networks() for [('48c641d5-f10b-46bc-b665-df597be281fe', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:42:18.882705 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:42:18.883158 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:42:18.883628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:42:18.884032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:42:18.884437 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:42:18.893303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:18.893778 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:18.894205 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:18.895581 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:18.896044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:18.896464 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:18.912848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:42:18.916855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Getting quotas for user ffe9a464991e4965a0638d0c23b17ae7 and project f69d85fa8dc545efb55a0b2949e9f06c. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:42:18.971966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:42:18.974125 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf8b68bf-5e35-482d-9322-ac4e793fce9e',volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:42:19.099654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-74380798-adc8-41f5-b51a-9499c2a1332c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717280 Sep 24 14:42:19.100294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 595/1169] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:42:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:42:19.111467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1a0cbb4d-8d0d-4c47-b89b-90271fc37273 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:19.112074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1a0cbb4d-8d0d-4c47-b89b-90271fc37273 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:19.115528 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=16 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:19.116780 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:19.170473 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a0cbb4d-8d0d-4c47-b89b-90271fc37273 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:19.178020 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1a0cbb4d-8d0d-4c47-b89b-90271fc37273 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1095 microversion: 2.1 time: 0.070539 Sep 24 14:42:19.178795 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 575/1170] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:19 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:20.200423 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:20.200961 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:20.208043 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:20.208522 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:20.208955 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:20.209634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:20.210084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:20.210505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:20.271014 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:20.278673 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7bbd25a9-8c3e-41ad-9518-5713be011c0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1193 microversion: 2.1 time: 0.082221 Sep 24 14:42:20.279276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 596/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:20 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:21.306238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:21.307018 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:21.314114 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:21.314720 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:21.315254 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:21.316014 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:21.316565 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:21.317050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:21.450238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:21.458487 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-915293cd-e2ff-4414-86dc-cb6832ae8a40 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.159415 Sep 24 14:42:21.459080 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 576/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:21 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:21.838398 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-419e51bc-2181-4c4e-8777-28ba76b5a76d req-e4011c1c-167f-4dce-8ffa-4304a986c6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3613674-9b41-4641-8852-c594d89b2313", "tag": "0362496f-1598-47b6-bdad-3f4b453675e7"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:42:21.848058 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-419e51bc-2181-4c4e-8777-28ba76b5a76d req-e4011c1c-167f-4dce-8ffa-4304a986c6fe service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:21.848758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-419e51bc-2181-4c4e-8777-28ba76b5a76d req-e4011c1c-167f-4dce-8ffa-4304a986c6fe service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:21.849188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-419e51bc-2181-4c4e-8777-28ba76b5a76d req-e4011c1c-167f-4dce-8ffa-4304a986c6fe service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:21.860893 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-419e51bc-2181-4c4e-8777-28ba76b5a76d req-e4011c1c-167f-4dce-8ffa-4304a986c6fe service nova] Creating event network-changed:0362496f-1598-47b6-bdad-3f4b453675e7 for instance f3613674-9b41-4641-8852-c594d89b2313 on hv-cinder-85919 Sep 24 14:42:21.865781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-419e51bc-2181-4c4e-8777-28ba76b5a76d req-e4011c1c-167f-4dce-8ffa-4304a986c6fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099807 Sep 24 14:42:21.866439 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 597/1173] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:42:22.481372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:22.481978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:22.488325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:22.488801 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:22.489229 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:22.489904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:22.490348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:22.490761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:22.616623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:22.624151 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-25da75ad-9c0b-4614-8018-2cbd66e09877 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.146601 Sep 24 14:42:22.624703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 577/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:22 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:23.648566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:23.649227 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:23.655273 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:23.655757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:23.656189 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:23.656873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:23.657320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:23.657742 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:24.117104 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:24.124659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2e114e0d-1510-4d28-bb8e-a65076d60d2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.481492 Sep 24 14:42:24.125217 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 598/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:23 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:25.147922 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:25.148551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:25.154862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:25.155337 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:25.155761 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:25.156431 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:25.156874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:25.157287 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:25.297433 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:25.305657 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-11e1b0a1-4d99-4499-ba99-69c3bec5ce7b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.162238 Sep 24 14:42:25.306219 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 578/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:25 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:26.329555 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:26.330169 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:26.336241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:26.336716 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:26.337175 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:26.337847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:26.338290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:26.338703 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:26.472041 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:26.480074 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0c310213-006c-4981-984d-b6510a460943 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.155309 Sep 24 14:42:26.480632 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 599/1177] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:26 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:27.503115 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:27.503839 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:27.510281 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:27.510757 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:27.511221 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:27.511903 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:27.512348 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:27.512769 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:27.643495 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:27.651673 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4950ca8e-04c7-4902-8e51-7dc459cdfd6c tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.152512 Sep 24 14:42:27.652231 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 579/1178] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:27 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:28.674650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:28.675213 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:28.682164 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:28.682650 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:28.683139 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:28.683825 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:28.684274 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:28.684692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:28.813001 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:28.821416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5f33888a-c138-489b-a844-439e162ceefb tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.150681 Sep 24 14:42:28.821999 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 600/1179] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:28 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:29.844526 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:29.845129 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:29.847483 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:29.852877 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:29.853366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:29.853806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:29.854496 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:29.854980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:29.855432 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:29.982326 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:29.990029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-506b9ad4-696b-4e5b-b0f0-db42aa6e39af tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.149359 Sep 24 14:42:29.990588 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 580/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:29 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:31.013435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:31.014065 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:31.015985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:31.016626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:31.023279 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:31.023758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:31.024186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:31.024865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:31.025342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:31.025759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:31.158490 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:31.166740 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-633f9a55-e7ea-4531-b982-2d167eda3932 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.157279 Sep 24 14:42:31.167331 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 601/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:31 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:32.189489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:32.190098 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:32.196914 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:32.197390 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:32.197817 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:32.198489 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:32.198957 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:32.199374 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:32.332824 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:32.340401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-90f43e73-9b66-4aac-87b3-eebe448f6996 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.154815 Sep 24 14:42:32.340967 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 581/1182] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:32 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:33.362739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:33.363390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:33.369750 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:33.370222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:33.370647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:33.371348 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:33.371790 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:33.372206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:33.502030 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:33.510089 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-bdacba03-077d-4933-a6fa-e784d45ce591 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.151264 Sep 24 14:42:33.510649 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 602/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:33 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:33.812081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-ae25d81a-1ad0-40fe-8611-ae740bb69fc8 req-47747901-feb7-4782-a420-9886b39cb0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3613674-9b41-4641-8852-c594d89b2313", "name": "network-vif-plugged", "status": "completed", "tag": "0362496f-1598-47b6-bdad-3f4b453675e7"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:42:33.822081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ae25d81a-1ad0-40fe-8611-ae740bb69fc8 req-47747901-feb7-4782-a420-9886b39cb0c7 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:33.822557 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ae25d81a-1ad0-40fe-8611-ae740bb69fc8 req-47747901-feb7-4782-a420-9886b39cb0c7 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:33.823052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ae25d81a-1ad0-40fe-8611-ae740bb69fc8 req-47747901-feb7-4782-a420-9886b39cb0c7 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:33.834492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-ae25d81a-1ad0-40fe-8611-ae740bb69fc8 req-47747901-feb7-4782-a420-9886b39cb0c7 service nova] Creating event network-vif-plugged:0362496f-1598-47b6-bdad-3f4b453675e7 for instance f3613674-9b41-4641-8852-c594d89b2313 on hv-cinder-85919 Sep 24 14:42:33.839543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-ae25d81a-1ad0-40fe-8611-ae740bb69fc8 req-47747901-feb7-4782-a420-9886b39cb0c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087219 Sep 24 14:42:33.840262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 582/1184] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:42:34.532885 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:34.533495 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:34.539788 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:34.540261 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:34.540689 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:34.541360 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:34.541801 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:34.542214 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:34.673083 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:34.681200 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-12486755-8b88-445b-a1a0-8328361ad93f tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.152159 Sep 24 14:42:34.681753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 603/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:34 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:35.705920 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:35.706615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:35.713502 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:35.713978 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:35.714899 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:35.715579 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:35.716051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:35.716468 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:35.844391 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:35.852071 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-53a0a53d-f664-40d9-80f2-2ed27f1b0c8b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1267 microversion: 2.1 time: 0.151263 Sep 24 14:42:35.852623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 583/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:35 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:36.874668 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:36.875313 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:36.881738 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:36.882219 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:36.882654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:36.883363 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:36.883817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:36.884241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:37.015098 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:37.023212 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2c2d4e80-57d7-48f5-8676-033de722d604 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1454 microversion: 2.1 time: 0.152556 Sep 24 14:42:37.023769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 604/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:36 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:37.045619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:37.046243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:37.052570 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:37.053050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:37.053488 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:37.054171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:37.054626 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:37.055078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:37.183380 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:37.191108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-11dd1132-cb49-4597-baf7-2369814c2454 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1454 microversion: 2.1 time: 0.149304 Sep 24 14:42:37.191661 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 584/1188] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:37 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:38.850458 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-9af61920-9617-4e08-a02f-91fa160da3b9 req-4155763f-67c1-448c-8354-2b4163c0792b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3613674-9b41-4641-8852-c594d89b2313", "tag": "0362496f-1598-47b6-bdad-3f4b453675e7"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:42:38.860141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-9af61920-9617-4e08-a02f-91fa160da3b9 req-4155763f-67c1-448c-8354-2b4163c0792b service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:38.860608 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-9af61920-9617-4e08-a02f-91fa160da3b9 req-4155763f-67c1-448c-8354-2b4163c0792b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:38.861028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-9af61920-9617-4e08-a02f-91fa160da3b9 req-4155763f-67c1-448c-8354-2b4163c0792b service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:38.871707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-9af61920-9617-4e08-a02f-91fa160da3b9 req-4155763f-67c1-448c-8354-2b4163c0792b service nova] Creating event network-changed:0362496f-1598-47b6-bdad-3f4b453675e7 for instance f3613674-9b41-4641-8852-c594d89b2313 on hv-cinder-85919 Sep 24 14:42:38.876613 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-9af61920-9617-4e08-a02f-91fa160da3b9 req-4155763f-67c1-448c-8354-2b4163c0792b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029985 Sep 24 14:42:38.877179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 605/1189] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:42:46.031063 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:46.031636 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:46.038362 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:46.038868 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:46.039305 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:46.039986 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:46.040467 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:46.040891 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:46.064120 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9c42eecf-03d1-4c91-960b-b7f593d84c35 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/ips" status: 200 len: 151 microversion: 2.1 time: 0.036971 Sep 24 14:42:46.064610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 585/1190] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:42:46 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:42:47.402133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d86047d8-dd8c-4a6b-82d6-ba90d2a12e71"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:42:47.404539 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:47.410504 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:47.411025 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:47.411715 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:47.412393 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:47.412839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:47.413262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:47.676941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e31cd90a-d800-486a-9cc3-6cf79db7cf53 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "POST /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279440 Sep 24 14:42:47.677793 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 606/1191] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:42:47 2022] POST /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:42:55.313382 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:55.313893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:55.316439 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=25 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:55.321572 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:55.322050 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:55.322484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:55.323201 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:55.323655 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:55.324077 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:55.326708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=55 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:55.402960 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lazy-loading 'services' on Instance uuid e460b5e2-3d4d-4493-b06c-ab6d5b037c65 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:42:55.478618 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-115cf9b6-2352-4a35-a9f3-2797f91ca775 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments/d86047d8-dd8c-4a6b-82d6-ba90d2a12e71" status: 202 len: 0 microversion: 2.1 time: 0.169116 Sep 24 14:42:55.479444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 586/1192] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:42:55 2022] DELETE /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments/d86047d8-dd8c-4a6b-82d6-ba90d2a12e71 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:42:55.488892 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:55.491855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:55.495457 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:55.500637 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:55.501115 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:55.501537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:55.502411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:55.502956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:55.503369 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:55.506628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:42:55.539828 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-42216fb0-c48e-47da-bcbf-67f5f7b61f6b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055176 Sep 24 14:42:55.540381 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 607/1193] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:42:55 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:42:56.553494 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:56.555880 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:56.562440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:56.562961 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:56.563387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:56.564056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:56.564500 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:56.564915 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:56.594346 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-511447d4-637d-4db7-a412-8b9e3d7c0629 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045690 Sep 24 14:42:56.594904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 587/1194] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:42:56 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:42:56.657710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:56.658190 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:56.665203 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:56.665686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:56.666121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:56.666807 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:56.667290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:56.667712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:56.692579 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Going to try to terminate instance {{(pid=120744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:42:56.765571 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-33e59ac7-0a81-467d-b8f0-e3c74d3ac9ad tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 204 len: 0 microversion: 2.1 time: 0.111294 Sep 24 14:42:56.766338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 608/1195] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:42:56 2022] DELETE /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:42:56.774595 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:56.775229 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:56.781108 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:56.781521 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:56.781948 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:56.782618 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:56.783085 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:56.783499 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:56.912539 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:56.920058 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-185dde69-58b2-4740-8ee4-af0b42fa77fc tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1683 microversion: 2.1 time: 0.149596 Sep 24 14:42:56.920615 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 588/1196] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:56 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:57.945247 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:57.945942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:57.952349 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:57.952835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:57.953266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:57.953941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:57.954390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:57.954850 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:58.082029 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:58.089684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e406793e-603a-44dc-8ac8-eb984818da8b tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1683 microversion: 2.1 time: 0.149230 Sep 24 14:42:58.090191 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 609/1197] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:57 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:59.112328 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:42:59.112863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:42:59.119823 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:59.120299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:59.120730 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:59.121401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:59.121845 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:59.122262 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:59.249252 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:42:59.259413 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da3218c6-60bd-4076-8c0c-b2b995f856ee tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1683 microversion: 2.1 time: 0.150364 Sep 24 14:42:59.259623 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 589/1198] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:42:59 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:42:59.969704 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-44e57d9a-65bd-4855-91cf-61f236f7fb14 req-a7b6274d-06b1-46eb-aad2-ad6a118cc1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e460b5e2-3d4d-4493-b06c-ab6d5b037c65", "name": "network-vif-deleted", "tag": "f999005f-69b1-4114-9abd-3afe92094553"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:42:59.981175 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-44e57d9a-65bd-4855-91cf-61f236f7fb14 req-a7b6274d-06b1-46eb-aad2-ad6a118cc1c8 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:42:59.982028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-44e57d9a-65bd-4855-91cf-61f236f7fb14 req-a7b6274d-06b1-46eb-aad2-ad6a118cc1c8 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:42:59.982691 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-44e57d9a-65bd-4855-91cf-61f236f7fb14 req-a7b6274d-06b1-46eb-aad2-ad6a118cc1c8 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:42:59.995005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-44e57d9a-65bd-4855-91cf-61f236f7fb14 req-a7b6274d-06b1-46eb-aad2-ad6a118cc1c8 service nova] Creating event network-vif-deleted:f999005f-69b1-4114-9abd-3afe92094553 for instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 on hv-cinder-85919 Sep 24 14:42:59.999975 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-44e57d9a-65bd-4855-91cf-61f236f7fb14 req-a7b6274d-06b1-46eb-aad2-ad6a118cc1c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034495 Sep 24 14:43:00.000979 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 610/1199] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:43:00.281767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:00.282366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:00.289571 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:00.290052 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:00.290492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:00.291217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:00.291675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:00.292107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:00.322393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:00.322912 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:00.323354 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:00.323810 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lazy-loading 'fault' on Instance uuid e460b5e2-3d4d-4493-b06c-ab6d5b037c65 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:43:00.368533 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb529f39710407abf9d6e1cedd9a603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21710ac430424ec9bf33aabfda5eb8ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:00.376406 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b8635baa-a9d9-4db6-af8a-f21ac3d3ed84 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 200 len: 1331 microversion: 2.1 time: 0.098484 Sep 24 14:43:00.376968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 590/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:00 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:01.400766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:01.401453 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:01.407902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:01.408376 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:01.408798 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:01.409465 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:01.409922 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:01.410337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:01.423817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 HTTP/1.1 Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:43:01.425388 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:01.427179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'e460b5e2-3d4d-4493-b06c-ab6d5b037c65'} Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:01.428648 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:01.430045 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:01.431320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:01.431320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-49c7f93d-82ec-411e-8b6e-3c3160fbf2a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 404 len: 111 microversion: 2.1 time: 0.030635 Sep 24 14:43:01.431320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 611/1201] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:01 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:43:01.436100 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a9c43d93-450a-4d43-be8b-bd21d79e4699 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '.version_select at 0x7f222acd31f0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:01.455130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a9c43d93-450a-4d43-be8b-bd21d79e4699 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308458409" status: 202 len: 0 microversion: 2.1 time: 0.022712 Sep 24 14:43:01.455663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 591/1202] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 14:43:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308458409 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 14:43:03.220802 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:03.221553 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:03.231749 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:03.232482 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:03.233141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:03.234179 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:03.234921 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:03.235575 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:03.254268 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 HTTP/1.1 Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:43:03.256395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.258121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'e460b5e2-3d4d-4493-b06c-ab6d5b037c65'} Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:03.259174 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.260829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.262370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:03.262370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e7062ab6-74dd-4404-b783-bd88eacf3579 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 404 len: 111 microversion: 2.1 time: 0.043666 Sep 24 14:43:03.262370 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 612/1203] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:43:03 2022] DELETE /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:43:03.267434 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:03.268043 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: e460b5e2-3d4d-4493-b06c-ab6d5b037c65] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:03.275001 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:03.275535 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:03.275971 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:03.276643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:03.277087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:03.277503 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:03.290974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 HTTP/1.1 Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:43:03.292608 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.294330 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'e460b5e2-3d4d-4493-b06c-ab6d5b037c65'} Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:03.295361 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. Sep 24 14:43:03.297097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:03.298558 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance e460b5e2-3d4d-4493-b06c-ab6d5b037c65 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:03.298558 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5accc9be-d32d-4eee-8a86-5677f01b4cc6 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65" status: 404 len: 111 microversion: 2.1 time: 0.030588 Sep 24 14:43:03.298558 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 592/1204] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:03 2022] GET /compute/v2.1/servers/e460b5e2-3d4d-4493-b06c-ab6d5b037c65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:43:04.433868 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:04.434368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:04.440672 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.441150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.441588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.442277 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.442725 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.443172 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.456123 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 HTTP/1.1 Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:43:04.457631 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.459368 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '18ffbba6-156b-4644-a4ef-28c5dcaffbd4'} Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:04.460857 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.462875 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.464557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:04.464557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2a759d3f-4d38-43bc-9a54-143e53fadd52 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 404 len: 111 microversion: 2.1 time: 0.028990 Sep 24 14:43:04.464557 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 613/1205] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:43:04 2022] DELETE /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:43:04.467083 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:04.467701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 18ffbba6-156b-4644-a4ef-28c5dcaffbd4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:04.473680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.474163 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.475126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.475813 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.476269 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.476692 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.489675 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 HTTP/1.1 Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:43:04.491850 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.493546 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '18ffbba6-156b-4644-a4ef-28c5dcaffbd4'} Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:04.494652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. Sep 24 14:43:04.496247 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.497786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance 18ffbba6-156b-4644-a4ef-28c5dcaffbd4 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:04.497786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dc07ae1f-c81d-4ca2-82ee-213bd4f8f565 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4" status: 404 len: 111 microversion: 2.1 time: 0.029877 Sep 24 14:43:04.497786 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 593/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:04 2022] GET /compute/v2.1/servers/18ffbba6-156b-4644-a4ef-28c5dcaffbd4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 14:43:04.502917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:04.503408 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:04.509163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.509633 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.510061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.510754 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.511226 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.511640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.525266 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb HTTP/1.1 Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:43:04.526760 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.528551 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '7469bc81-1670-47f3-95c4-d1092e46a9fb'} Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:04.529628 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.531285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.532902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:04.532902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-11cfbe1a-0f31-4b3f-bf81-0b98e56ad4c4 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 404 len: 111 microversion: 2.1 time: 0.029072 Sep 24 14:43:04.532902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 614/1207] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:43:04 2022] DELETE /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:43:04.536386 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:04.537980 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: 7469bc81-1670-47f3-95c4-d1092e46a9fb] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:04.543851 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.544338 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.544774 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.545460 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:04.545913 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:04.546339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:04.559510 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb HTTP/1.1 Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:43:04.561026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.562701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '7469bc81-1670-47f3-95c4-d1092e46a9fb'} Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:04.563700 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. Sep 24 14:43:04.565302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:04.566806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance 7469bc81-1670-47f3-95c4-d1092e46a9fb could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:04.566806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-733195aa-e8cb-4e08-bbcc-c3aa99df65a2 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb" status: 404 len: 111 microversion: 2.1 time: 0.029788 Sep 24 14:43:04.566806 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 594/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:04 2022] GET /compute/v2.1/servers/7469bc81-1670-47f3-95c4-d1092e46a9fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 14:43:05.700049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:05.700558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:05.708326 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:05.708793 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:05.709262 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:05.709941 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:05.710383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:05.710796 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:05.723876 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc HTTP/1.1 Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:43:05.725963 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.727721 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'c97c9001-9a6b-44d2-bbf3-aca4ea818bbc'} Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:05.728706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.730397 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.732054 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:05.732054 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d0e2884f-976c-410c-a1e2-32d5df912585 tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 404 len: 111 microversion: 2.1 time: 0.031416 Sep 24 14:43:05.732054 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 615/1209] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:43:05 2022] DELETE /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 14:43:05.735765 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:05.736368 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] [instance: c97c9001-9a6b-44d2-bbf3-aca4ea818bbc] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:05.743501 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:05.743973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:05.744404 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:05.745069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:05.745511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:05.745926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:05.758875 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] HTTP exception thrown: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Request method failure captured: Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc HTTP/1.1 Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxWXVmztWn4RS33o-OsA8q5G2SnntIm7ncqHVMKKkDTFnRMxJtRIfvKEOlxIyIRoHTOJ4K9x9xccV1f4fWE6lmz7d11_959z5mLu53nVzlYN7Mxu7Gr9zV6M4KHi0DKyp2yuvtLQrzs7So8PiEuD7OfdWFprOloHUGFBTRzS2diFVdA Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:43:05.760365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_21710ac430424ec9bf33aabfda5eb8ba", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/21710ac430424ec9bf33aabfda5eb8ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/21710ac430424ec9bf33aabfda5eb8ba"}]}] Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 21710ac430424ec9bf33aabfda5eb8ba Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-959126854 Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: abb529f39710407abf9d6e1cedd9a603 Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-959126854-project Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.762066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'c97c9001-9a6b-44d2-bbf3-aca4ea818bbc'} Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:05.763064 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. Sep 24 14:43:05.764680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:05.766122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] Returning 404 to user: Instance c97c9001-9a6b-44d2-bbf3-aca4ea818bbc could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:05.766122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-782efc10-1390-46cb-8950-8daf03d89a0a tempest-AttachVolumeNegativeTest-959126854 tempest-AttachVolumeNegativeTest-959126854-project] 10.222.0.52 "GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc" status: 404 len: 111 microversion: 2.1 time: 0.029772 Sep 24 14:43:05.766122 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 595/1210] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:05 2022] GET /compute/v2.1/servers/c97c9001-9a6b-44d2-bbf3-aca4ea818bbc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:43:16.122943 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:16.124059 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:16.126630 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:43:16.127307 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:43:16.134080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:16.134572 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:16.135034 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:16.135732 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:16.136186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:16.136611 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:16.171463 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b710c0ae-9a4a-4808-9d60-d4734ff71728 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053526 Sep 24 14:43:16.172695 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 616/1211] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:43:16 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:43:16.238214 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:16.238752 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:16.242006 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:43:16.243118 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:43:16.248578 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:16.249055 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:16.249484 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:16.250165 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:16.250611 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:16.251057 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:16.276835 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:43:16.357444 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7967a7b1-be32-4713-9f8f-24e239df811b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 204 len: 0 microversion: 2.1 time: 0.122590 Sep 24 14:43:16.358425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 596/1212] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:43:16 2022] DELETE /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:43:16.367143 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:16.367841 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:16.374865 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:16.375540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:16.376061 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:16.376871 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:16.377345 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:16.377763 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:16.511706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:16.519448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-5169e12f-38d6-41d0-aee9-12b47a6b2a34 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1673 microversion: 2.1 time: 0.156871 Sep 24 14:43:16.520017 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 617/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:16 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:17.543794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:17.544401 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:17.550607 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:17.551179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:17.551610 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:17.552283 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:17.552728 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:17.553640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:17.687938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:17.695968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fff7dd64-41b4-4d14-8813-1ad7cba03a02 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1673 microversion: 2.1 time: 0.156452 Sep 24 14:43:17.696545 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 597/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:17 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:18.720194 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:18.720936 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:18.727232 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:18.727701 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:18.728140 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:18.728831 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:18.729290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:18.729710 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:18.902047 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:18.910748 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cec5b2b8-5a72-4264-be1c-8220cbc35ce2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1673 microversion: 2.1 time: 0.194558 Sep 24 14:43:18.911409 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 618/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:18 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:19.704592 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-42f7cd49-ff6b-4617-a155-a9f80b9617c3 req-8f3e0f79-ef7b-458d-a313-977f96738ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65d370-8082-417a-bb3d-5816c602da9f", "name": "network-vif-deleted", "tag": "1e1b1630-2a20-474d-8181-2d01b2f828a6"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:43:19.715013 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-42f7cd49-ff6b-4617-a155-a9f80b9617c3 req-8f3e0f79-ef7b-458d-a313-977f96738ef6 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:19.715559 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-42f7cd49-ff6b-4617-a155-a9f80b9617c3 req-8f3e0f79-ef7b-458d-a313-977f96738ef6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:19.716070 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-42f7cd49-ff6b-4617-a155-a9f80b9617c3 req-8f3e0f79-ef7b-458d-a313-977f96738ef6 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:19.729340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-42f7cd49-ff6b-4617-a155-a9f80b9617c3 req-8f3e0f79-ef7b-458d-a313-977f96738ef6 service nova] Creating event network-vif-deleted:1e1b1630-2a20-474d-8181-2d01b2f828a6 for instance ee65d370-8082-417a-bb3d-5816c602da9f on hv-cinder-85919 Sep 24 14:43:19.734619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-42f7cd49-ff6b-4617-a155-a9f80b9617c3 req-8f3e0f79-ef7b-458d-a313-977f96738ef6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Sep 24 14:43:19.735963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 598/1216] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:43:19.933362 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:19.934769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:19.942069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:19.942854 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:19.943376 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:19.945974 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:19.946433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:19.946882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:19.979861 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:19.980340 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:19.980772 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:19.981206 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.objects.instance [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lazy-loading 'fault' on Instance uuid ee65d370-8082-417a-bb3d-5816c602da9f {{(pid=120744) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:43:20.027116 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:20.034626 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-67e7303c-73c4-47b4-a704-7c48f7430366 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 200 len: 1325 microversion: 2.1 time: 0.105121 Sep 24 14:43:20.035211 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 619/1217] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:19 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 1325 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:21.058591 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:21.059307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:21.065358 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:21.065831 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:21.066259 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:21.066958 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:21.067405 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:21.067819 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:21.080736 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] HTTP exception thrown: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Request method failure captured: Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f HTTP/1.1 Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxZ3BQZi-9VoGyEryHZy7EaDpR9IPxu-ylhzx1zbLsOIMxp5kKy16i3FXbreL3oZHqaN_GTNbUxBbU3DuIVEcIt3wrbf-wF1gz0qKPcWcQn1OrcAZamjtsgJIS11NEMtitQdf33dU8dWRSKkZwE6-15VcyLdzZbvnwODOMIIHEJIppo Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:43:21.082364 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cfc1e3a42706435a93301d76ee7b74ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cfc1e3a42706435a93301d76ee7b74ed"}]}] Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: f5d7b40e78a049cd83d079291c3601ff Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:43:21.084766 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'ee65d370-8082-417a-bb3d-5816c602da9f'} Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:43:21.085874 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:43:21.087709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:43:21.089217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Returning 404 to user: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:43:21.089217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d90ccda8-d8e1-49d9-9549-b2d447b08fca tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 404 len: 111 microversion: 2.1 time: 0.029808 Sep 24 14:43:21.089217 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 599/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:21 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:43:21.092836 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c30ccc29-6d8b-42f6-beba-d72c2c5cf1ce tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '.version_select at 0x7f222abd9670>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:21.112516 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c30ccc29-6d8b-42f6-beba-d72c2c5cf1ce tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-57655990" status: 202 len: 0 microversion: 2.1 time: 0.023415 Sep 24 14:43:21.113053 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 620/1219] 10.222.0.52 () {58 vars in 1215 bytes} [Sat Sep 24 14:43:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-57655990 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:43:21.707065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c491a5c-0440-4450-a404-026f57bbe7da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'create', calling method: .version_select at 0x7f222acd34c0>, body: {"keypair": {"name": "tempest-keypair-2114278570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe6L/wo1+bn78XK1yNSpMHC1YOIQfKVbQmykyj5yaPbNn8PJoIhi8oaNZFNQ1GcLmEh1Lb7ud8Fw8iPr73d9Q8OqUXcNmawtGwl29vJdD2TC6Nj7lYYfDRjLcm7Ifh2UQ=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:43:21.724695 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-0c491a5c-0440-4450-a404-026f57bbe7da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:43:21.728541 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-0c491a5c-0440-4450-a404-026f57bbe7da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for user f5d7b40e78a049cd83d079291c3601ff and project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:43:21.750755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0c491a5c-0440-4450-a404-026f57bbe7da tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048360 Sep 24 14:43:21.751367 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 600/1220] 10.222.0.52 () {60 vars in 1159 bytes} [Sat Sep 24 14:43:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:43:23.008498 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-685847743", "imageRef": "38401a92-af88-4d5d-aeb1-d7f990f3d494", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91a2cf93-1fab-4d21-a55a-3c3eecea066b"}], "security_groups": [{"name": "tempest-securitygroup--1452790537"}], "key_name": "tempest-keypair-2114278570", "user_data": "}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:43:23.115983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.network.neutron [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] validate_networks() for [('91a2cf93-1fab-4d21-a55a-3c3eecea066b', None, None, None, None, None)] {{(pid=120744) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 14:43:23.499896 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Flavor limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 14:43:23.500320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Image limits 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 14:43:23.500830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Flavor pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 14:43:23.501238 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Image pref 0:0:0 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 14:43:23.501652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.virt.hardware [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120744) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 14:43:23.510374 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:23.510881 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:23.511526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:23.512254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:23.512708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:23.513315 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:23.532462 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 14:43:23.536556 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.quota [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Getting quotas for user f5d7b40e78a049cd83d079291c3601ff and project cfc1e3a42706435a93301d76ee7b74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=120744) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 14:43:23.548411 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Going to run 1 instances... {{(pid=120744) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 14:43:23.551290 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='38401a92-af88-4d5d-aeb1-d7f990f3d494',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120744) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 14:43:23.601804 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-65f5dc3d-22a1-4368-adbf-aba0caaabb94 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598559 Sep 24 14:43:23.602443 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 621/1221] 10.222.0.52 () {60 vars in 1147 bytes} [Sat Sep 24 14:43:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 14:43:23.613708 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4bb987fe-76dd-4baf-bc55-b75ea3cfb608 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:23.614318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4bb987fe-76dd-4baf-bc55-b75ea3cfb608 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:23.679942 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4bb987fe-76dd-4baf-bc55-b75ea3cfb608 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:23.688707 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4bb987fe-76dd-4baf-bc55-b75ea3cfb608 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1237 microversion: 2.1 time: 0.078902 Sep 24 14:43:23.695904 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 601/1222] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:23 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:24.713981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:24.714848 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:24.722570 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:24.723275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:24.724335 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:24.726153 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:24.726739 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:24.727461 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:24.807835 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:24.820791 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-b3c411be-d065-493e-8395-d87edfdc9756 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1289 microversion: 2.1 time: 0.107788 Sep 24 14:43:24.821867 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 622/1223] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:24 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:25.846631 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:25.847900 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:25.858372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:25.859191 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:25.859926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:25.860929 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:25.861650 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:25.862365 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:26.015186 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:26.023043 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9e6072d4-9846-45b9-8d96-6fc6f06ac89b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.182075 Sep 24 14:43:26.023970 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 602/1224] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:25 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:26.415049 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-6515fcdf-57ed-4c54-8959-5b37a19e732e req-d4736b94-b3eb-4488-9740-fb5c4063374e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa119332-1fec-4562-b59a-014764db6d86", "tag": "b5e0cb17-571d-424a-b755-8ca871bb6e5a"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:43:26.429781 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6515fcdf-57ed-4c54-8959-5b37a19e732e req-d4736b94-b3eb-4488-9740-fb5c4063374e service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:26.430260 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6515fcdf-57ed-4c54-8959-5b37a19e732e req-d4736b94-b3eb-4488-9740-fb5c4063374e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:26.430690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-6515fcdf-57ed-4c54-8959-5b37a19e732e req-d4736b94-b3eb-4488-9740-fb5c4063374e service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:26.453307 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-6515fcdf-57ed-4c54-8959-5b37a19e732e req-d4736b94-b3eb-4488-9740-fb5c4063374e service nova] Creating event network-changed:b5e0cb17-571d-424a-b755-8ca871bb6e5a for instance aa119332-1fec-4562-b59a-014764db6d86 on hv-cinder-85919 Sep 24 14:43:26.460152 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-6515fcdf-57ed-4c54-8959-5b37a19e732e req-d4736b94-b3eb-4488-9740-fb5c4063374e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049160 Sep 24 14:43:26.461218 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 623/1225] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:43:27.046704 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:27.047310 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:27.054174 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:27.054648 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:27.055111 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:27.055792 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:27.056241 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:27.056663 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:27.187863 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:27.196025 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cd8b3ff5-58e9-494a-bef8-30417b74f860 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.153269 Sep 24 14:43:27.196597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 603/1226] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:27 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:28.221873 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:28.222562 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:28.228634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:28.229115 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:28.229545 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:28.230224 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:28.230787 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:28.231235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:28.364021 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:28.373195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-7f140b0a-0aa1-43dc-b944-dd9c4c7cfb9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.155885 Sep 24 14:43:28.374141 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 624/1227] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:28 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:29.396269 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:29.396859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:29.403753 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:29.404225 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:29.404652 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:29.405325 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:29.405769 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:29.406188 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:29.541318 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:29.548885 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b84e3095-5fe5-4953-a08a-259966aeb9a2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.156544 Sep 24 14:43:29.549464 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 604/1228] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:29 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:30.571110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:30.571969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:30.578762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:30.579272 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:30.579708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:30.580386 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:30.580839 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:30.581265 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:30.796573 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:30.804334 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-be469b7c-efaa-4fec-b741-8eb9cae118bd tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.237691 Sep 24 14:43:30.804894 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 625/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:30 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:31.827175 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:31.827752 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:31.834750 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:31.835852 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:31.836547 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:31.837014 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:31.837464 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:31.837883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:31.968997 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:31.976677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-aa514f5a-7302-4e99-84df-e6bb7859583a tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.153725 Sep 24 14:43:31.977238 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 605/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:31 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:32.999895 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:33.000492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:33.006980 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:33.008084 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:33.008516 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:33.009194 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:33.009643 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:33.010063 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:33.136744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:33.144537 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-942bc077-1332-40d3-867a-e840a6f63d9c tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.148990 Sep 24 14:43:33.145098 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 626/1231] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:32 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:34.100578 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-96be7e45-ea16-46fe-ba8f-deff42c1d3df req-1a5226d4-8346-41a3-8280-e26fe97684ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa119332-1fec-4562-b59a-014764db6d86", "name": "network-vif-plugged", "status": "completed", "tag": "b5e0cb17-571d-424a-b755-8ca871bb6e5a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:43:34.105917 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:43:34.112392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-96be7e45-ea16-46fe-ba8f-deff42c1d3df req-1a5226d4-8346-41a3-8280-e26fe97684ff service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:34.113010 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-96be7e45-ea16-46fe-ba8f-deff42c1d3df req-1a5226d4-8346-41a3-8280-e26fe97684ff service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:34.113443 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-96be7e45-ea16-46fe-ba8f-deff42c1d3df req-1a5226d4-8346-41a3-8280-e26fe97684ff service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:34.124640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-96be7e45-ea16-46fe-ba8f-deff42c1d3df req-1a5226d4-8346-41a3-8280-e26fe97684ff service nova] Creating event network-vif-plugged:b5e0cb17-571d-424a-b755-8ca871bb6e5a for instance aa119332-1fec-4562-b59a-014764db6d86 on hv-cinder-85919 Sep 24 14:43:34.129699 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-96be7e45-ea16-46fe-ba8f-deff42c1d3df req-1a5226d4-8346-41a3-8280-e26fe97684ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032814 Sep 24 14:43:34.130299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 606/1232] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:43:34.168914 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:34.169638 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:34.171855 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:43:34.173069 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell0:SELECT=6 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:43:34.180751 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:34.181430 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:34.182062 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:34.182972 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:34.183491 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:34.184116 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:34.337993 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:34.348275 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-df42a0d3-b1ad-483d-9a9e-1101ab15df11 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.182777 Sep 24 14:43:34.349320 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 627/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:34 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:35.379097 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:35.379811 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:35.386101 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:35.386590 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:35.387387 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:35.388601 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:35.389378 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:35.390078 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:35.521830 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:35.530865 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b5c6be40-e394-4ee3-a96b-ef364110490b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1363 microversion: 2.1 time: 0.158464 Sep 24 14:43:35.531441 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 607/1234] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:35 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:36.555050 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:36.555659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:36.561564 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:36.562048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:36.562483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:36.563195 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:36.563647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:36.564070 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:36.694403 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:43:36.702186 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-269f2910-b16f-4d96-8d2b-8fd07e78690f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1549 microversion: 2.1 time: 0.151838 Sep 24 14:43:36.702755 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 628/1235] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:43:36 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:43:36.727446 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:43:36.728037 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:43:36.734200 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:36.734680 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:36.735157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:36.735843 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:36.736295 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:36.736716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:36.816418 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e32b5818-1bb6-454e-b0e1-e3ddc698dee3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093556 Sep 24 14:43:36.817185 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 608/1236] 10.222.0.52 () {58 vars in 1275 bytes} [Sat Sep 24 14:43:36 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:43:37.720775 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-af7abf24-ebde-45e7-b199-2bf3ccbcd202 req-2ab81758-6eb2-4647-b98f-c37b1e8ffa66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa119332-1fec-4562-b59a-014764db6d86", "tag": "b5e0cb17-571d-424a-b755-8ca871bb6e5a"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:43:37.730570 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-af7abf24-ebde-45e7-b199-2bf3ccbcd202 req-2ab81758-6eb2-4647-b98f-c37b1e8ffa66 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:43:37.731163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-af7abf24-ebde-45e7-b199-2bf3ccbcd202 req-2ab81758-6eb2-4647-b98f-c37b1e8ffa66 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:43:37.731654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-af7abf24-ebde-45e7-b199-2bf3ccbcd202 req-2ab81758-6eb2-4647-b98f-c37b1e8ffa66 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:43:37.744985 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-af7abf24-ebde-45e7-b199-2bf3ccbcd202 req-2ab81758-6eb2-4647-b98f-c37b1e8ffa66 service nova] Creating event network-changed:b5e0cb17-571d-424a-b755-8ca871bb6e5a for instance aa119332-1fec-4562-b59a-014764db6d86 on hv-cinder-85919 Sep 24 14:43:37.750357 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-af7abf24-ebde-45e7-b199-2bf3ccbcd202 req-2ab81758-6eb2-4647-b98f-c37b1e8ffa66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033206 Sep 24 14:43:37.751310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 629/1237] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:44:42.262220 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:44:42.264644 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:44:42.266193 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:44:42.267009 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=68 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:44:42.273578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-0c85b3af-d5a2-4055-9409-77d31bcff0e7 req-409499fc-e880-4f9c-a332-7a4c6eb0ca8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3613674-9b41-4641-8852-c594d89b2313", "tag": "0362496f-1598-47b6-bdad-3f4b453675e7"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:44:42.285919 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:42.286422 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:42.293835 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:42.294353 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:42.295357 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:42.296056 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:42.296508 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:42.296928 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:42.302759 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-0c85b3af-d5a2-4055-9409-77d31bcff0e7 req-409499fc-e880-4f9c-a332-7a4c6eb0ca8f service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:42.303372 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-0c85b3af-d5a2-4055-9409-77d31bcff0e7 req-409499fc-e880-4f9c-a332-7a4c6eb0ca8f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:42.303803 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-0c85b3af-d5a2-4055-9409-77d31bcff0e7 req-409499fc-e880-4f9c-a332-7a4c6eb0ca8f service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:42.325846 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-0c85b3af-d5a2-4055-9409-77d31bcff0e7 req-409499fc-e880-4f9c-a332-7a4c6eb0ca8f service nova] Creating event network-changed:0362496f-1598-47b6-bdad-3f4b453675e7 for instance f3613674-9b41-4641-8852-c594d89b2313 on hv-cinder-85919 Sep 24 14:44:42.331448 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-0c85b3af-d5a2-4055-9409-77d31bcff0e7 req-409499fc-e880-4f9c-a332-7a4c6eb0ca8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071254 Sep 24 14:44:42.332335 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 630/1238] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:44:42.339590 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:44:42.426952 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fbe07d74-91ab-4f28-b7db-1515424760f8 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 204 len: 0 microversion: 2.1 time: 0.170279 Sep 24 14:44:42.427974 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 609/1239] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:44:42 2022] DELETE /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:44:42.436903 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:42.437604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:42.444080 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:42.444566 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:42.444998 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:42.445684 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:42.446138 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:42.446560 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:42.583659 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:44:42.592546 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e7b7d054-8d62-4962-8c64-45668c6118d7 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1579 microversion: 2.1 time: 0.160057 Sep 24 14:44:42.593493 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 631/1240] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:42 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:44:43.616604 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:43.617307 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:43.624093 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:43.624584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:43.625023 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:43.625711 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:43.626164 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:43.626586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:43.763392 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:44:43.771208 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a195bcbc-68b2-47be-bff2-53ef705c57aa tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1579 microversion: 2.1 time: 0.158903 Sep 24 14:44:43.771776 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 610/1241] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:43 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:44:44.794019 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:44.794609 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:44.801188 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:44.801662 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:44.802107 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:44.802771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:44.803446 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:44.803652 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:45.021945 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:44:45.029686 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-3b08f185-2133-4175-8487-9622476a7a9b tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 200 len: 1460 microversion: 2.1 time: 0.239848 Sep 24 14:44:45.030240 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 632/1242] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:44 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 1460 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:44:45.049190 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-36fde625-e920-40eb-b5f6-3b34c88240f1 req-df9d8dda-6715-4361-9b7b-436f7add884a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3613674-9b41-4641-8852-c594d89b2313", "name": "network-vif-deleted", "tag": "0362496f-1598-47b6-bdad-3f4b453675e7"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:44:45.060113 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-36fde625-e920-40eb-b5f6-3b34c88240f1 req-df9d8dda-6715-4361-9b7b-436f7add884a service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:45.061087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-36fde625-e920-40eb-b5f6-3b34c88240f1 req-df9d8dda-6715-4361-9b7b-436f7add884a service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:45.061511 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-36fde625-e920-40eb-b5f6-3b34c88240f1 req-df9d8dda-6715-4361-9b7b-436f7add884a service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:45.073250 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-36fde625-e920-40eb-b5f6-3b34c88240f1 req-df9d8dda-6715-4361-9b7b-436f7add884a service nova] Creating event network-vif-deleted:0362496f-1598-47b6-bdad-3f4b453675e7 for instance f3613674-9b41-4641-8852-c594d89b2313 on hv-cinder-85919 Sep 24 14:44:45.078712 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-36fde625-e920-40eb-b5f6-3b34c88240f1 req-df9d8dda-6715-4361-9b7b-436f7add884a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Sep 24 14:44:45.079339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 611/1243] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:44:46.053886 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:46.054483 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: f3613674-9b41-4641-8852-c594d89b2313] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:46.061949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:46.062430 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:46.062907 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:46.063604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:46.064051 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:46.064469 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:46.077902 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] HTTP exception thrown: Instance f3613674-9b41-4641-8852-c594d89b2313 could not be found. Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Request method failure captured: Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 HTTP/1.1 Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxXinELuSKnz0zFqj_QVIvrTr9-T912ihopNRWhnHayGuPUpODgBQaIpQY-6aRzG-4dVS6jxhgigoqh4NxJyhSNaUXKmLhD-deqf1rJCg4gtrf6-cvF_QzPqBQ5vepWBi3Qk8uxa9Ckj_M1ML3WNNimurpF4wO9qYtJE5Jd4lud7PgM Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:44:46.079617 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f69d85fa8dc545efb55a0b2949e9f06c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f69d85fa8dc545efb55a0b2949e9f06c"}]}] Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: ffe9a464991e4965a0638d0c23b17ae7 Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance f3613674-9b41-4641-8852-c594d89b2313 could not be found. Sep 24 14:44:46.081384 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'f3613674-9b41-4641-8852-c594d89b2313'} Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3613674-9b41-4641-8852-c594d89b2313 could not be found. Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:44:46.082303 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3613674-9b41-4641-8852-c594d89b2313 could not be found. Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3613674-9b41-4641-8852-c594d89b2313 could not be found. Sep 24 14:44:46.083817 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:46.085133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Returning 404 to user: Instance f3613674-9b41-4641-8852-c594d89b2313 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:44:46.085133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d8f5d2b6-4070-4de5-966c-7c68ffb58b2d tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313" status: 404 len: 111 microversion: 2.1 time: 0.031416 Sep 24 14:44:46.085133 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 633/1244] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:46 2022] GET /compute/v2.1/servers/f3613674-9b41-4641-8852-c594d89b2313 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:44:49.123236 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:49.123814 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:49.125108 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-fbad591e-8eb0-4485-aeeb-f84a6643d214 req-b3b4cfa0-71b4-46da-8fb6-ce36d8da5f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d37bc53-2176-4fcf-abab-a9771cb0667f", "tag": "2bd0d195-ca08-40d0-a830-a7c73d18e828"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:44:49.130279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:49.131531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:49.132179 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:49.132901 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:49.133349 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:49.133764 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:49.135526 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fbad591e-8eb0-4485-aeeb-f84a6643d214 req-b3b4cfa0-71b4-46da-8fb6-ce36d8da5f89 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:49.135992 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fbad591e-8eb0-4485-aeeb-f84a6643d214 req-b3b4cfa0-71b4-46da-8fb6-ce36d8da5f89 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:49.136607 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-fbad591e-8eb0-4485-aeeb-f84a6643d214 req-b3b4cfa0-71b4-46da-8fb6-ce36d8da5f89 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:49.148128 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-fbad591e-8eb0-4485-aeeb-f84a6643d214 req-b3b4cfa0-71b4-46da-8fb6-ce36d8da5f89 service nova] Creating event network-changed:2bd0d195-ca08-40d0-a830-a7c73d18e828 for instance 0d37bc53-2176-4fcf-abab-a9771cb0667f on hv-cinder-85919 Sep 24 14:44:49.153416 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-fbad591e-8eb0-4485-aeeb-f84a6643d214 req-b3b4cfa0-71b4-46da-8fb6-ce36d8da5f89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032118 Sep 24 14:44:49.154355 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 634/1245] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:44:49.164747 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:44:49.243243 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b5d3dab2-e835-44ca-8fc4-d0fb165e5cf2 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 204 len: 0 microversion: 2.1 time: 0.124346 Sep 24 14:44:49.246514 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 612/1246] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:44:49 2022] DELETE /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:44:49.255549 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:49.256241 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:49.264753 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:49.265548 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:49.265981 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:49.267435 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:49.268028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:49.268449 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:49.450954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:44:49.459310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-eb9e7d3e-6af8-4eb3-8967-9e85d7bb3b0a tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1578 microversion: 2.1 time: 0.207853 Sep 24 14:44:49.459910 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 635/1247] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:49 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:44:50.485107 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:50.485798 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:50.492051 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:50.492522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:50.492946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:50.493617 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:50.494065 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:50.494481 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:50.625195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:44:50.633044 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e012a31f-5c31-4abb-a0d9-f1b497f3bf47 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1578 microversion: 2.1 time: 0.152609 Sep 24 14:44:50.633618 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 613/1248] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:50 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:44:51.657294 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:51.658544 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:51.665222 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:51.665707 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:51.666132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:51.666847 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:51.667492 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:51.667911 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:51.767706 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffe9a464991e4965a0638d0c23b17ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69d85fa8dc545efb55a0b2949e9f06c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:44:51.781540 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-74b4773b-c9d3-4523-bdca-44d103fd00e3 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 200 len: 1391 microversion: 2.1 time: 0.128084 Sep 24 14:44:51.782129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 636/1249] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:51 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 1391 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:44:51.784926 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-418c9957-8af0-4a4a-a284-b0470a51e6b3 req-b9371080-7e2b-4d93-9c19-7f9da87cebd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d37bc53-2176-4fcf-abab-a9771cb0667f", "name": "network-vif-deleted", "tag": "2bd0d195-ca08-40d0-a830-a7c73d18e828"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:44:51.796230 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-418c9957-8af0-4a4a-a284-b0470a51e6b3 req-b9371080-7e2b-4d93-9c19-7f9da87cebd4 service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:51.796709 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-418c9957-8af0-4a4a-a284-b0470a51e6b3 req-b9371080-7e2b-4d93-9c19-7f9da87cebd4 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:51.797135 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-418c9957-8af0-4a4a-a284-b0470a51e6b3 req-b9371080-7e2b-4d93-9c19-7f9da87cebd4 service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:51.807968 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-418c9957-8af0-4a4a-a284-b0470a51e6b3 req-b9371080-7e2b-4d93-9c19-7f9da87cebd4 service nova] Creating event network-vif-deleted:2bd0d195-ca08-40d0-a830-a7c73d18e828 for instance 0d37bc53-2176-4fcf-abab-a9771cb0667f on hv-cinder-85919 Sep 24 14:44:51.813209 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-418c9957-8af0-4a4a-a284-b0470a51e6b3 req-b9371080-7e2b-4d93-9c19-7f9da87cebd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033256 Sep 24 14:44:51.813794 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 614/1250] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:44:52.803969 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:52.804524 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 0d37bc53-2176-4fcf-abab-a9771cb0667f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:52.810954 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:52.811440 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:52.812482 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:52.813171 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:52.813625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:52.814048 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:52.827498 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] HTTP exception thrown: Instance 0d37bc53-2176-4fcf-abab-a9771cb0667f could not be found. Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Request method failure captured: Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f HTTP/1.1 Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxXinELuSKnz0zFqj_QVIvrTr9-T912ihopNRWhnHayGuPUpODgBQaIpQY-6aRzG-4dVS6jxhgigoqh4NxJyhSNaUXKmLhD-deqf1rJCg4gtrf6-cvF_QzPqBQ5vepWBi3Qk8uxa9Ckj_M1ML3WNNimurpF4wO9qYtJE5Jd4lud7PgM Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:44:52.829181 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f69d85fa8dc545efb55a0b2949e9f06c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f69d85fa8dc545efb55a0b2949e9f06c"}]}] Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: ffe9a464991e4965a0638d0c23b17ae7 Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 0d37bc53-2176-4fcf-abab-a9771cb0667f could not be found. Sep 24 14:44:52.831006 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '0d37bc53-2176-4fcf-abab-a9771cb0667f'} Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d37bc53-2176-4fcf-abab-a9771cb0667f could not be found. Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:44:52.831977 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d37bc53-2176-4fcf-abab-a9771cb0667f could not be found. Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d37bc53-2176-4fcf-abab-a9771cb0667f could not be found. Sep 24 14:44:52.833644 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:52.835178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Returning 404 to user: Instance 0d37bc53-2176-4fcf-abab-a9771cb0667f could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:44:52.835178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-db4feb11-5034-4706-8a83-ff61aefeab60 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f" status: 404 len: 111 microversion: 2.1 time: 0.030654 Sep 24 14:44:52.835178 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 637/1251] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:52 2022] GET /compute/v2.1/servers/0d37bc53-2176-4fcf-abab-a9771cb0667f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:44:53.507946 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:53.508531 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:53.514577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:53.515656 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:53.516095 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:53.516767 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:53.517213 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:53.517630 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:53.530785 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] HTTP exception thrown: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Request method failure captured: Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: DELETE /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b HTTP/1.1 Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxXinELuSKnz0zFqj_QVIvrTr9-T912ihopNRWhnHayGuPUpODgBQaIpQY-6aRzG-4dVS6jxhgigoqh4NxJyhSNaUXKmLhD-deqf1rJCg4gtrf6-cvF_QzPqBQ5vepWBi3Qk8uxa9Ckj_M1ML3WNNimurpF4wO9qYtJE5Jd4lud7PgM Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:44:53.532862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f69d85fa8dc545efb55a0b2949e9f06c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f69d85fa8dc545efb55a0b2949e9f06c"}]}] Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: ffe9a464991e4965a0638d0c23b17ae7 Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.534577 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '706136cf-b0bb-4a89-951d-a22ef9428b0b'} Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:44:53.535734 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.537429 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.539551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Returning 404 to user: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:44:53.539551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e16c12fb-1167-45f7-bc27-39d959fba976 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "DELETE /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 404 len: 111 microversion: 2.1 time: 0.031128 Sep 24 14:44:53.539551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 615/1252] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:44:53 2022] DELETE /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:44:53.543118 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:53.543731 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] [instance: 706136cf-b0bb-4a89-951d-a22ef9428b0b] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:44:53.550127 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:53.550606 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:53.551071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:53.551756 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:44:53.552210 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:44:53.552634 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:44:53.566395 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] HTTP exception thrown: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Request method failure captured: Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b HTTP/1.1 Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxXinELuSKnz0zFqj_QVIvrTr9-T912ihopNRWhnHayGuPUpODgBQaIpQY-6aRzG-4dVS6jxhgigoqh4NxJyhSNaUXKmLhD-deqf1rJCg4gtrf6-cvF_QzPqBQ5vepWBi3Qk8uxa9Ckj_M1ML3WNNimurpF4wO9qYtJE5Jd4lud7PgM Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:44:53.567926 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f69d85fa8dc545efb55a0b2949e9f06c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f69d85fa8dc545efb55a0b2949e9f06c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f69d85fa8dc545efb55a0b2949e9f06c"}]}] Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: f69d85fa8dc545efb55a0b2949e9f06c Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-TestVolumeBootPattern-1305912312 Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: ffe9a464991e4965a0638d0c23b17ae7 Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-TestVolumeBootPattern-1305912312-project Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.569623 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '706136cf-b0bb-4a89-951d-a22ef9428b0b'} Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:44:53.570692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. Sep 24 14:44:53.572942 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:44:53.574382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Returning 404 to user: Instance 706136cf-b0bb-4a89-951d-a22ef9428b0b could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:44:53.574382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-bde31a6d-b1c5-4878-ac4f-f995c2247e44 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b" status: 404 len: 111 microversion: 2.1 time: 0.030025 Sep 24 14:44:53.574382 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 638/1253] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:44:53 2022] GET /compute/v2.1/servers/706136cf-b0bb-4a89-951d-a22ef9428b0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:44:54.859793 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d87da4d4-24b8-4799-a89c-696571321d12 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] Calling method '.version_select at 0x7f222abe5b80>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:44:54.881246 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d87da4d4-24b8-4799-a89c-696571321d12 tempest-TestVolumeBootPattern-1305912312 tempest-TestVolumeBootPattern-1305912312-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2083695467" status: 202 len: 0 microversion: 2.1 time: 0.025282 Sep 24 14:44:54.881834 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 616/1254] 10.222.0.52 () {58 vars in 1263 bytes} [Sat Sep 24 14:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2083695467 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:45:10.348692 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=18 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:10.349337 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=34 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:10.592508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:10.593005 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:10.599137 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:10.599558 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:10.599983 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:10.600664 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:10.601112 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:10.601531 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:10.625342 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-cd90c04e-521e-4a20-b643-41c3a4b3d11f tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/ips" status: 200 len: 146 microversion: 2.1 time: 0.281578 Sep 24 14:45:10.625882 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 639/1255] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:45:10 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/ips => generated 146 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:11.961562 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac4e467-6d46-4da4-a311-ab4fd11768e6"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:45:11.963952 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:11.966072 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:11.966701 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:11.968529 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 14:45:11.968672 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Sat Sep 24 14:45:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments (ip 10.222.0.52) !!! Sep 24 14:45:11.978360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:11.978862 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:11.979299 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:11.979985 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:11.980425 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:11.980837 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:12.241414 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-59d7d4fa-4897-47c9-8e6c-60d8f7754272 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283808 Sep 24 14:45:12.242039 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 617/1256] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:45:11 2022] POST /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:19.778640 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:19.781625 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:19.788474 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:19.788956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:19.789390 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:19.790149 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:19.790604 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:19.791129 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:19.828744 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d4243f13-fd56-4f3c-9ce1-98f4f4608d55 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053960 Sep 24 14:45:19.829297 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 640/1257] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:45:19 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:19.841026 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:19.841599 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:19.848400 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:19.848873 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:19.849298 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:19.849972 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:19.850416 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:19.850846 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:19.878440 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de18d84a-b467-4ff0-9570-cffe76cc7b86 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6ac4e467-6d46-4da4-a311-ab4fd11768e6" status: 200 len: 194 microversion: 2.1 time: 0.042294 Sep 24 14:45:19.879031 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 618/1258] 10.222.0.52 () {58 vars in 1413 bytes} [Sat Sep 24 14:45:19 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6ac4e467-6d46-4da4-a311-ab4fd11768e6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:21.216113 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d22bc35-2040-4274-be94-f6a44314d3f4"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:45:21.219287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:21.225639 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:21.226110 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:21.226535 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:21.227235 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:21.227682 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:21.228096 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:21.485276 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f3b80380-d033-470a-849a-87033ce5aa8b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "POST /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272882 Sep 24 14:45:21.489007 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 641/1259] 10.222.0.52 () {60 vars in 1323 bytes} [Sat Sep 24 14:45:21 2022] POST /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:29.021157 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:29.023372 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:29.029719 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:29.030200 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:29.030640 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:29.031381 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:29.031832 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:29.032257 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:29.061543 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-122daa5d-977a-4aa8-8848-8a10d26fe454 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044337 Sep 24 14:45:29.062081 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 619/1260] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:45:29 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 14:45:29.206145 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:29.206671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:29.212681 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:29.213151 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:29.213610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:29.214285 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:29.214761 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:29.215200 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:29.242872 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-1a37eb1b-3997-4836-9164-ddd6518b23e6 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6ac4e467-6d46-4da4-a311-ab4fd11768e6" status: 200 len: 194 microversion: 2.1 time: 0.042125 Sep 24 14:45:29.243432 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 642/1261] 10.222.0.52 () {58 vars in 1413 bytes} [Sat Sep 24 14:45:29 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6ac4e467-6d46-4da4-a311-ab4fd11768e6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:29.254194 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:29.254676 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:29.260523 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:29.261002 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:29.261525 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:29.262424 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:29.263069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:29.263568 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:29.346066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lazy-loading 'services' on Instance uuid aa119332-1fec-4562-b59a-014764db6d86 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:45:29.418221 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-149a887b-3225-49c8-8a6f-0b2ba86e49e2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6ac4e467-6d46-4da4-a311-ab4fd11768e6" status: 202 len: 0 microversion: 2.1 time: 0.168172 Sep 24 14:45:29.418839 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 620/1262] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:45:29 2022] DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6ac4e467-6d46-4da4-a311-ab4fd11768e6 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 14:45:31.601199 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:31.601733 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:31.608121 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:31.608598 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:31.609026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:31.609709 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:31.610163 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:31.610588 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:31.638251 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-d6eaaac8-92c3-444e-94a7-1701085c5047 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6d22bc35-2040-4274-be94-f6a44314d3f4" status: 200 len: 194 microversion: 2.1 time: 0.041073 Sep 24 14:45:31.638844 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 643/1263] 10.222.0.52 () {58 vars in 1413 bytes} [Sat Sep 24 14:45:31 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6d22bc35-2040-4274-be94-f6a44314d3f4 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:31.650808 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:31.651411 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:31.658074 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:31.658549 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:31.659020 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:31.659703 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:31.660159 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:31.660581 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:31.741002 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lazy-loading 'services' on Instance uuid aa119332-1fec-4562-b59a-014764db6d86 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 14:45:31.809716 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d31e58f5-1d7a-4852-993e-a47f7f74cc3e tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6d22bc35-2040-4274-be94-f6a44314d3f4" status: 202 len: 0 microversion: 2.1 time: 0.163345 Sep 24 14:45:31.810232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 621/1264] 10.222.0.52 () {58 vars in 1416 bytes} [Sat Sep 24 14:45:31 2022] DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments/6d22bc35-2040-4274-be94-f6a44314d3f4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 14:45:32.981508 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:32.983736 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:32.990569 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:32.991071 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:32.991499 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:32.992168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:32.992610 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:32.993026 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:33.021132 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-6c7f380e-e613-47e3-b21c-21d99c7b55cb tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043514 Sep 24 14:45:33.021662 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 644/1265] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:45:32 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:45:33.134800 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:33.137130 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:33.143694 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:33.144178 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:33.144619 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:33.145302 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:33.145755 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:33.146178 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:33.174859 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0b8c5c3b-af3b-418e-b61c-987756c22518 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044715 Sep 24 14:45:33.175398 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 622/1266] 10.222.0.52 () {58 vars in 1302 bytes} [Sat Sep 24 14:45:33 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 14:45:33.238768 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:33.239287 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:33.245044 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:33.245519 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:33.245948 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:33.246622 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:33.247097 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:33.247512 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:33.272771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Going to try to terminate instance {{(pid=120744) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 14:45:33.345655 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-e34f9757-ef70-4452-b3b0-cf187c5932d3 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 204 len: 0 microversion: 2.1 time: 0.109749 Sep 24 14:45:33.346310 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 645/1267] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:45:33 2022] DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 14:45:33.355742 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:33.356282 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:33.362073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:33.362547 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:33.363019 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:33.363693 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:33.364166 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:33.364584 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:33.493210 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:45:33.501352 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8c770637-7940-41c9-a7a6-c3d954192579 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1674 microversion: 2.1 time: 0.149049 Sep 24 14:45:33.501910 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 623/1268] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:45:33 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:45:34.526052 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:34.526747 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:34.533690 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:34.534171 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:34.534603 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:34.535313 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:34.535766 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:34.536187 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:34.920254 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.policy [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120744) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:45:34.928299 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2fd1da68-1d79-4b04-ac1f-7abe7b43f737 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1674 microversion: 2.1 time: 0.406434 Sep 24 14:45:34.928859 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 646/1269] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:45:34 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1674 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:45:35.952214 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:35.952825 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:35.959818 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:35.960522 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:35.961360 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:35.962153 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:35.962643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:35.963149 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:36.103906 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d7b40e78a049cd83d079291c3601ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc1e3a42706435a93301d76ee7b74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 14:45:36.112466 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-784daa58-f166-4c17-a389-1d31e5a0e232 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 200 len: 1674 microversion: 2.1 time: 0.164365 Sep 24 14:45:36.113047 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 624/1270] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:45:35 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:45:36.385148 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [req-1185f102-6fca-4e72-bd8c-a95b117913e7 req-dc9ff5fa-240f-4224-824f-605d37638ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa119332-1fec-4562-b59a-014764db6d86", "name": "network-vif-deleted", "tag": "b5e0cb17-571d-424a-b755-8ca871bb6e5a"}]} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:45:36.397467 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-1185f102-6fca-4e72-bd8c-a95b117913e7 req-dc9ff5fa-240f-4224-824f-605d37638ffd service nova] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:36.397949 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-1185f102-6fca-4e72-bd8c-a95b117913e7 req-dc9ff5fa-240f-4224-824f-605d37638ffd service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:36.398383 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [req-1185f102-6fca-4e72-bd8c-a95b117913e7 req-dc9ff5fa-240f-4224-824f-605d37638ffd service nova] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:36.410246 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.compute.server_external_events [req-1185f102-6fca-4e72-bd8c-a95b117913e7 req-dc9ff5fa-240f-4224-824f-605d37638ffd service nova] Creating event network-vif-deleted:b5e0cb17-571d-424a-b755-8ca871bb6e5a for instance aa119332-1fec-4562-b59a-014764db6d86 on hv-cinder-85919 Sep 24 14:45:36.416431 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [req-1185f102-6fca-4e72-bd8c-a95b117913e7 req-dc9ff5fa-240f-4224-824f-605d37638ffd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035835 Sep 24 14:45:36.417344 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 647/1271] 10.222.0.52 () {64 vars in 1317 bytes} [Sat Sep 24 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:37.139973 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:37.140594 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:37.147788 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:37.148279 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:37.148717 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:37.149412 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:37.149876 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:37.150285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:37.165285 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] HTTP exception thrown: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Request method failure captured: Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 HTTP/1.1 Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxZ3BQZi-9VoGyEryHZy7EaDpR9IPxu-ylhzx1zbLsOIMxp5kKy16i3FXbreL3oZHqaN_GTNbUxBbU3DuIVEcIt3wrbf-wF1gz0qKPcWcQn1OrcAZamjtsgJIS11NEMtitQdf33dU8dWRSKkZwE6-15VcyLdzZbvnwODOMIIHEJIppo Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:45:37.167008 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cfc1e3a42706435a93301d76ee7b74ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cfc1e3a42706435a93301d76ee7b74ed"}]}] Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: f5d7b40e78a049cd83d079291c3601ff Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:37.168660 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'aa119332-1fec-4562-b59a-014764db6d86'} Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:37.169963 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:37.171490 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:37.174340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Returning 404 to user: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:37.174340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2a6a3a25-0908-4432-8be7-93dabf04bb97 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 404 len: 111 microversion: 2.1 time: 0.032386 Sep 24 14:45:37.174340 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 625/1272] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:45:37 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:37.178032 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-a4997b60-65b6-44fc-8dce-0cbcd5c76387 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '.version_select at 0x7f222ad2d940>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:37.197380 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-a4997b60-65b6-44fc-8dce-0cbcd5c76387 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114278570" status: 202 len: 0 microversion: 2.1 time: 0.023487 Sep 24 14:45:37.197956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 648/1273] 10.222.0.52 () {58 vars in 1221 bytes} [Sat Sep 24 14:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114278570 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:45:40.079612 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:40.080091 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:40.086743 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:40.087195 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:40.087627 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:40.088309 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:40.088756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:40.089176 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:40.102981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] HTTP exception thrown: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Request method failure captured: Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 HTTP/1.1 Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxZ3BQZi-9VoGyEryHZy7EaDpR9IPxu-ylhzx1zbLsOIMxp5kKy16i3FXbreL3oZHqaN_GTNbUxBbU3DuIVEcIt3wrbf-wF1gz0qKPcWcQn1OrcAZamjtsgJIS11NEMtitQdf33dU8dWRSKkZwE6-15VcyLdzZbvnwODOMIIHEJIppo Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:45:40.104492 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cfc1e3a42706435a93301d76ee7b74ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cfc1e3a42706435a93301d76ee7b74ed"}]}] Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: f5d7b40e78a049cd83d079291c3601ff Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.106033 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'aa119332-1fec-4562-b59a-014764db6d86'} Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:40.106938 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.108643 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.110393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Returning 404 to user: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:40.110393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-146bcb5a-9636-4162-91a2-223ed6160f0d tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 404 len: 111 microversion: 2.1 time: 0.030551 Sep 24 14:45:40.110393 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 626/1274] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:45:40 2022] DELETE /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:40.114745 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:40.115505 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: aa119332-1fec-4562-b59a-014764db6d86] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:40.122067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:40.122547 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:40.123028 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:40.123714 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:40.124168 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:40.124587 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:40.137352 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] HTTP exception thrown: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Request method failure captured: Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 HTTP/1.1 Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxZ3BQZi-9VoGyEryHZy7EaDpR9IPxu-ylhzx1zbLsOIMxp5kKy16i3FXbreL3oZHqaN_GTNbUxBbU3DuIVEcIt3wrbf-wF1gz0qKPcWcQn1OrcAZamjtsgJIS11NEMtitQdf33dU8dWRSKkZwE6-15VcyLdzZbvnwODOMIIHEJIppo Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:45:40.138956 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cfc1e3a42706435a93301d76ee7b74ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cfc1e3a42706435a93301d76ee7b74ed"}]}] Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: f5d7b40e78a049cd83d079291c3601ff Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.140671 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'aa119332-1fec-4562-b59a-014764db6d86'} Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:40.142270 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. Sep 24 14:45:40.143924 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:40.145400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Returning 404 to user: Instance aa119332-1fec-4562-b59a-014764db6d86 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:40.145400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-c93cd168-734b-4506-bed7-f9092b3ac3f8 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86" status: 404 len: 111 microversion: 2.1 time: 0.030003 Sep 24 14:45:40.145400 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 649/1275] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:45:40 2022] GET /compute/v2.1/servers/aa119332-1fec-4562-b59a-014764db6d86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:41.279587 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:41.280062 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:41.286893 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:41.287370 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:41.287799 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:41.288727 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:41.289171 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:41.289586 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:41.302538 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] HTTP exception thrown: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Request method failure captured: Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: DELETE /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f HTTP/1.1 Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxZ3BQZi-9VoGyEryHZy7EaDpR9IPxu-ylhzx1zbLsOIMxp5kKy16i3FXbreL3oZHqaN_GTNbUxBbU3DuIVEcIt3wrbf-wF1gz0qKPcWcQn1OrcAZamjtsgJIS11NEMtitQdf33dU8dWRSKkZwE6-15VcyLdzZbvnwODOMIIHEJIppo Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:45:41.304073 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cfc1e3a42706435a93301d76ee7b74ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cfc1e3a42706435a93301d76ee7b74ed"}]}] Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: f5d7b40e78a049cd83d079291c3601ff Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: > Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.305827 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'ee65d370-8082-417a-bb3d-5816c602da9f'} Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:41.307029 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.308738 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.310339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Returning 404 to user: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:41.310339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d8899271-32ea-4d70-8d69-4fd6ef6f62d2 tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 404 len: 111 microversion: 2.1 time: 0.029624 Sep 24 14:45:41.310339 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 627/1276] 10.222.0.52 () {58 vars in 1239 bytes} [Sat Sep 24 14:45:41 2022] DELETE /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:41.313737 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Calling method '>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:41.314378 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.compute.api [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] [instance: ee65d370-8082-417a-bb3d-5816c602da9f] Fetching instance by UUID {{(pid=120744) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 14:45:41.316808 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:41.322153 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:41.322629 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:41.323088 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:41.323769 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Acquiring lock "76c0b987-cac9-4795-a959-19f9a0a44deb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:45:41.324221 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:45:41.324647 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG oslo_concurrency.lockutils [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Lock "76c0b987-cac9-4795-a959-19f9a0a44deb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:45:41.333538 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:41.344708 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] HTTP exception thrown: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Request method failure captured: Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f HTTP/1.1 Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxZ3BQZi-9VoGyEryHZy7EaDpR9IPxu-ylhzx1zbLsOIMxp5kKy16i3FXbreL3oZHqaN_GTNbUxBbU3DuIVEcIt3wrbf-wF1gz0qKPcWcQn1OrcAZamjtsgJIS11NEMtitQdf33dU8dWRSKkZwE6-15VcyLdzZbvnwODOMIIHEJIppo Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:45:41.346327 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cfc1e3a42706435a93301d76ee7b74ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cfc1e3a42706435a93301d76ee7b74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cfc1e3a42706435a93301d76ee7b74ed"}]}] Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: cfc1e3a42706435a93301d76ee7b74ed Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1208947376 Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: f5d7b40e78a049cd83d079291c3601ff Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-AttachVolumeTestJSON-1208947376-project Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: > Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.348677 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'ee65d370-8082-417a-bb3d-5816c602da9f'} Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:41.349842 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. Sep 24 14:45:41.351478 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:41.353173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] Returning 404 to user: Instance ee65d370-8082-417a-bb3d-5816c602da9f could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:41.353173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-919602e5-29d4-4899-bb81-483fef5c9f9b tempest-AttachVolumeTestJSON-1208947376 tempest-AttachVolumeTestJSON-1208947376-project] 10.222.0.52 "GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f" status: 404 len: 111 microversion: 2.1 time: 0.038426 Sep 24 14:45:41.353173 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 650/1277] 10.222.0.52 () {58 vars in 1236 bytes} [Sat Sep 24 14:45:41 2022] GET /compute/v2.1/servers/ee65d370-8082-417a-bb3d-5816c602da9f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:45.712069 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-67ce0752-6e0d-4318-a713-ac57274001b1 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Action: 'create', calling method: .version_select at 0x7f222aac2790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1228359047"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:45:46.021637 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-67ce0752-6e0d-4318-a713-ac57274001b1 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.425961 Sep 24 14:45:46.022332 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 628/1278] 10.222.0.52 () {60 vars in 1155 bytes} [Sat Sep 24 14:45:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 14:45:46.035316 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-12c5dc15-c03a-4870-b00c-ab1ba78d1c4d tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222e138a60>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:46.095722 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-12c5dc15-c03a-4870-b00c-ab1ba78d1c4d tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f" status: 200 len: 345 microversion: 2.1 time: 0.064483 Sep 24 14:45:46.096298 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 651/1279] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:45:46 2022] GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:47.111090 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b1dc1e7f-54bc-4dac-87e8-26d1dffdc939 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222ab248b0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:47.158223 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b1dc1e7f-54bc-4dac-87e8-26d1dffdc939 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f" status: 200 len: 346 microversion: 2.1 time: 0.051439 Sep 24 14:45:47.158825 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 629/1280] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:45:47 2022] GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:47.172669 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-ae2ad768-0d83-48b1-8ec0-d8f0147f2868 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Action: 'create', calling method: .version_select at 0x7f222acc14c0>, body: {"snapshot": {"volume_id": "10a070cd-efab-4954-bb52-7fd71ca08e0f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1581529701"}} {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:45:47.322578 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-ae2ad768-0d83-48b1-8ec0-d8f0147f2868 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.154045 Sep 24 14:45:47.323279 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 652/1281] 10.222.0.52 () {60 vars in 1162 bytes} [Sat Sep 24 14:45:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:47.334550 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6e6b7070-81c2-4368-a2f3-2076bc493197 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222abe51f0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:47.367558 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6e6b7070-81c2-4368-a2f3-2076bc493197 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 200 len: 287 microversion: 2.1 time: 0.037327 Sep 24 14:45:47.368126 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 630/1282] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:47 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:47.379160 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-2c40fc56-2364-47e5-9f97-da7da3420dc9 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222e38bf70>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:47.410556 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-2c40fc56-2364-47e5-9f97-da7da3420dc9 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035128 Sep 24 14:45:47.411150 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 653/1283] 10.222.0.52 () {58 vars in 1140 bytes} [Sat Sep 24 14:45:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:47.422696 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2244419f-76e6-4a79-99d1-6b5dc94c206f tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222acd3700>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:47.451087 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2244419f-76e6-4a79-99d1-6b5dc94c206f tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 200 len: 287 microversion: 2.1 time: 0.032093 Sep 24 14:45:47.451632 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 631/1284] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:47 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:48.464338 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-74e066a8-d66c-473b-8bb9-a0c74e828658 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222acc19d0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:48.492712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-74e066a8-d66c-473b-8bb9-a0c74e828658 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 200 len: 287 microversion: 2.1 time: 0.032749 Sep 24 14:45:48.493292 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 654/1285] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:48 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:49.506597 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-52bdbf28-351d-4c08-b6e8-1f91c1d36701 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222aac2280>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:49.536883 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-52bdbf28-351d-4c08-b6e8-1f91c1d36701 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 200 len: 287 microversion: 2.1 time: 0.035187 Sep 24 14:45:49.537421 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 632/1286] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:49 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:50.550771 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-82aabe06-0f07-40b2-b780-6c3fb9615b6c tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222e31fb80>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:50.579597 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-82aabe06-0f07-40b2-b780-6c3fb9615b6c tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 200 len: 287 microversion: 2.1 time: 0.033583 Sep 24 14:45:50.580135 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 655/1287] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:50 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:51.588833 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=22 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:51.590257 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:51.594152 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e4dc97fe-5c59-40eb-ab11-c29202e365ba tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222aaa8d30>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:51.631682 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e4dc97fe-5c59-40eb-ab11-c29202e365ba tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 200 len: 288 microversion: 2.1 time: 0.043781 Sep 24 14:45:51.632662 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 633/1288] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:51 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:51.641701 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG dbcounter [-] [120744] Writing DB stats nova_api:SELECT=1 {{(pid=120744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:45:51.646829 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-f5240778-34d5-44ba-affb-c10d00d26afa tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222e359940>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:51.706654 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-f5240778-34d5-44ba-affb-c10d00d26afa tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 202 len: 0 microversion: 2.1 time: 0.065021 Sep 24 14:45:51.707255 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 656/1289] 10.222.0.52 () {58 vars in 1254 bytes} [Sat Sep 24 14:45:51 2022] DELETE /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:45:51.715248 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-96e409c8-16f4-482f-9fae-ea4e13a91109 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222acd35e0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:51.744366 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-96e409c8-16f4-482f-9fae-ea4e13a91109 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 200 len: 287 microversion: 2.1 time: 0.032825 Sep 24 14:45:51.744925 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 634/1290] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:51 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:52.758078 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-74cb19a9-ea16-4944-94d2-1eb4312c4cb0 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222e138b80>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:52.782470 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-74cb19a9-ea16-4944-94d2-1eb4312c4cb0 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] HTTP exception thrown: Snapshot cfb27eac-8674-4689-aeec-92e52a863703 could not be found. Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-74cb19a9-ea16-4944-94d2-1eb4312c4cb0 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Request method failure captured: Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 HTTP/1.1 Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxgZWpXQrXJ77m8DAcgv4HGIIdooZnYTYkym2HWxT6ZKyqAKDFZeEZr6GNivCJfTVGp1QmHXvIkn1CaJ5YJIAwN8F1w3RSSN0XwHyyrhap1oUjcmRVXy30YPrifmv7GyndH-J-ASlc4e5aqYWgZu9Tqra4RHR4LjSVynYnxvu1B7q-o Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:45:52.784762 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b760bf5beae47c5a9f75e921f8c55eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b760bf5beae47c5a9f75e921f8c55eb"}]}] Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 58f8b828dbc14525ba70827291e35057 Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Snapshot cfb27eac-8674-4689-aeec-92e52a863703 could not be found. Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': 'cfb27eac-8674-4689-aeec-92e52a863703'} Sep 24 14:45:52.786646 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cfb27eac-8674-4689-aeec-92e52a863703 could not be found. (HTTP 404) (Request-ID: req-c1bdac8d-1a9e-4567-9c94-9590d894fdb1) Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:52.787932 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:45:52.789830 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cfb27eac-8674-4689-aeec-92e52a863703 could not be found. Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 24 14:45:52.791717 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cfb27eac-8674-4689-aeec-92e52a863703 could not be found. Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cfb27eac-8674-4689-aeec-92e52a863703 could not be found. Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-74cb19a9-ea16-4944-94d2-1eb4312c4cb0 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Returning 404 to user: Snapshot cfb27eac-8674-4689-aeec-92e52a863703 could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:52.793433 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-74cb19a9-ea16-4944-94d2-1eb4312c4cb0 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703" status: 404 len: 111 microversion: 2.1 time: 0.032420 Sep 24 14:45:52.794591 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 657/1291] 10.222.0.52 () {58 vars in 1251 bytes} [Sat Sep 24 14:45:52 2022] GET /compute/v2.1/os-snapshots/cfb27eac-8674-4689-aeec-92e52a863703 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:52.795334 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fdad457d-4a72-4d67-b02b-1ff685af4b97 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222ab36a60>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:52.855949 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fdad457d-4a72-4d67-b02b-1ff685af4b97 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f" status: 202 len: 0 microversion: 2.1 time: 0.064745 Sep 24 14:45:52.856509 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 635/1292] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:45:52 2022] DELETE /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:45:52.865917 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-bd299b73-2950-4a89-b7d0-6f8fa7c1d517 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222acc19d0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:52.915067 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-bd299b73-2950-4a89-b7d0-6f8fa7c1d517 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f" status: 200 len: 345 microversion: 2.1 time: 0.054042 Sep 24 14:45:52.915627 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 658/1293] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:45:52 2022] GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:45:53.930726 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfaf5e26-8503-4ae1-9847-c1d96fc89f08 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222aa19280>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:53.958049 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-dfaf5e26-8503-4ae1-9847-c1d96fc89f08 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] HTTP exception thrown: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfaf5e26-8503-4ae1-9847-c1d96fc89f08 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Request method failure captured: Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f HTTP/1.1 Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxgZWpXQrXJ77m8DAcgv4HGIIdooZnYTYkym2HWxT6ZKyqAKDFZeEZr6GNivCJfTVGp1QmHXvIkn1CaJ5YJIAwN8F1w3RSSN0XwHyyrhap1oUjcmRVXy30YPrifmv7GyndH-J-ASlc4e5aqYWgZu9Tqra4RHR4LjSVynYnxvu1B7q-o Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:45:53.959984 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b760bf5beae47c5a9f75e921f8c55eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b760bf5beae47c5a9f75e921f8c55eb"}]}] Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: 58f8b828dbc14525ba70827291e35057 Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '10a070cd-efab-4954-bb52-7fd71ca08e0f'} Sep 24 14:45:53.961756 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. (HTTP 404) (Request-ID: req-359779ab-0ec5-4c1e-a783-efc37448853c) Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:53.962890 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:45:53.964455 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 14:45:53.965981 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfaf5e26-8503-4ae1-9847-c1d96fc89f08 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Returning 404 to user: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dfaf5e26-8503-4ae1-9847-c1d96fc89f08 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f" status: 404 len: 109 microversion: 2.1 time: 0.035009 Sep 24 14:45:53.967551 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 636/1294] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:45:53 2022] GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:53.976229 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0f4cc781-3438-4e30-afc8-749ff938149d tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222e1389d0>' {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:54.003031 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.wsgi [None req-0f4cc781-3438-4e30-afc8-749ff938149d tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] HTTP exception thrown: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0f4cc781-3438-4e30-afc8-749ff938149d tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Request method failure captured: Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: request: DELETE /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f HTTP/1.1 Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept: application/json Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Accept-Encoding: identity Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Connection: close Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Length: 0 Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Content-Type: application/json Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Host: 10.222.0.52 Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: Openstack-System-Scope: None Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Auth-Token: gAAAAABjLxgZWpXQrXJ77m8DAcgv4HGIIdooZnYTYkym2HWxT6ZKyqAKDFZeEZr6GNivCJfTVGp1QmHXvIkn1CaJ5YJIAwN8F1w3RSSN0XwHyyrhap1oUjcmRVXy30YPrifmv7GyndH-J-ASlc4e5aqYWgZu9Tqra4RHR4LjSVynYnxvu1B7q-o Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Id: None Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Domain-Name: None Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Identity-Status: Confirmed Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Is-Admin-Project: True Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Id: default Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Domain-Name: Default Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Role: member,reader Sep 24 14:45:54.004966 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Roles: member,reader Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b760bf5beae47c5a9f75e921f8c55eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b760bf5beae47c5a9f75e921f8c55eb"}]}] Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Id: default Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Domain-Name: Default Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Id: 58f8b828dbc14525ba70827291e35057 Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: method: Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: exception: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: action_args: {'id': '10a070cd-efab-4954-bb52-7fd71ca08e0f'} Sep 24 14:45:54.006843 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: {{(pid=120744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. (HTTP 404) (Request-ID: req-1292dd7a-dd7e-4f70-afe7-0e7fc8334c4f) Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:54.007757 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 14:45:54.009592 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 14:45:54.012758 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: DEBUG nova.api.openstack.wsgi [None req-0f4cc781-3438-4e30-afc8-749ff938149d tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Returning 404 to user: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. {{(pid=120744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:54.015391 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: INFO nova.api.openstack.requestlog [None req-0f4cc781-3438-4e30-afc8-749ff938149d tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f" status: 404 len: 109 microversion: 2.1 time: 0.035028 Sep 24 14:45:54.016712 dv-cinder-859193-1-iscsi devstack@n-api.service[120744]: [pid: 120744|app: 0|req: 659/1295] 10.222.0.52 () {58 vars in 1248 bytes} [Sat Sep 24 14:45:53 2022] DELETE /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 14:45:54.016820 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8d636dfd-4782-4113-b2eb-fd30deb1e9a5 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Calling method '.version_select at 0x7f222abe5a60>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:45:54.045306 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-8d636dfd-4782-4113-b2eb-fd30deb1e9a5 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] HTTP exception thrown: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8d636dfd-4782-4113-b2eb-fd30deb1e9a5 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Request method failure captured: Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f HTTP/1.1 Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept: application/json Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Connection: close Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.52 Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjLxgZWpXQrXJ77m8DAcgv4HGIIdooZnYTYkym2HWxT6ZKyqAKDFZeEZr6GNivCJfTVGp1QmHXvIkn1CaJ5YJIAwN8F1w3RSSN0XwHyyrhap1oUjcmRVXy30YPrifmv7GyndH-J-ASlc4e5aqYWgZu9Tqra4RHR4LjSVynYnxvu1B7q-o Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Role: member,reader Sep 24 14:45:54.047356 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Roles: member,reader Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1b760bf5beae47c5a9f75e921f8c55eb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1b760bf5beae47c5a9f75e921f8c55eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1b760bf5beae47c5a9f75e921f8c55eb"}]}] Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 1b760bf5beae47c5a9f75e921f8c55eb Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1354565854 Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Id: 58f8b828dbc14525ba70827291e35057 Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1354565854-project Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: method: Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: exception: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '10a070cd-efab-4954-bb52-7fd71ca08e0f'} Sep 24 14:45:54.049066 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. (HTTP 404) (Request-ID: req-8a10c6cb-3ed1-41c6-b264-6113b263b65d) Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:54.050377 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 14:45:54.052079 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 14:45:54.053677 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8d636dfd-4782-4113-b2eb-fd30deb1e9a5 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] Returning 404 to user: Volume 10a070cd-efab-4954-bb52-7fd71ca08e0f could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8d636dfd-4782-4113-b2eb-fd30deb1e9a5 tempest-VolumesSnapshotsTestJSON-1354565854 tempest-VolumesSnapshotsTestJSON-1354565854-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f" status: 404 len: 109 microversion: 2.1 time: 0.037865 Sep 24 14:45:54.055232 dv-cinder-859193-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 637/1296] 10.222.0.52 () {58 vars in 1245 bytes} [Sat Sep 24 14:45:54 2022] GET /compute/v2.1/os-volumes/10a070cd-efab-4954-bb52-7fd71ca08e0f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)